Apr 09 10:34:54 devstack cinder-volume[72916]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 10:34:54 devstack cinder-volume[72916]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 10:34:54 devstack cinder-volume[72916]: we strongly recommend against using it for new projects.
Apr 09 10:34:54 devstack cinder-volume[72916]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 10:34:54 devstack cinder-volume[72916]: framework.  For more detail see
Apr 09 10:34:54 devstack cinder-volume[72916]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 10:34:54 devstack cinder-volume[72916]:   import eventlet  # noqa
Apr 09 10:34:56 devstack cinder-volume[72916]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:34:56 devstack cinder-volume[72916]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:34:56 devstack cinder-volume[72916]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:34:56 devstack cinder-volume[72916]: INFO dbcounter [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Registered counter for database cinder
Apr 09 10:34:56 devstack cinder-volume[72916]: DEBUG oslo_db.sqlalchemy.engines [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG dbcounter [-] [72916] Writer thread running {{(pid=72916) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.rpc [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.rpc [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_db.sqlalchemy.engines [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.volume.manager [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Determined volume DB was empty at startup.
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG cinder.volume.manager [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72916) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.volume.manager [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 09 10:34:57 devstack cinder-volume[72916]: WARNING stevedore.named [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 10:34:57 devstack cinder-volume[72916]: WARNING castellan.key_manager [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:34:57 devstack cinder-volume[72916]: WARNING cinder.keymgr.conf_key_mgr [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG cinder.volume.drivers.lvm [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72916) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_concurrency.processutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_concurrency.processutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] CMD "cinder-rtstool verify" returned: 0 in 0.281s {{(pid=72916) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_db.sqlalchemy.engines [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.rpc [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.rpc [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 09 10:34:57 devstack cinder-volume[72916]: WARNING stevedore.named [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 10:34:57 devstack cinder-volume[72916]: WARNING castellan.key_manager [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO cinder.volume.manager [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_db.sqlalchemy.engines [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:34:57 devstack cinder-volume[72916]: INFO oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Starting 1 workers
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Started child 73022 {{(pid=72916) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Full set of CONF: {{(pid=72916) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] ******************************************************************************** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Configuration options gathered from: {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] ================================================================================ {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] allow_availability_zone_fallback = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] allow_compression_on_image_upload = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] allowed_direct_url_schemes     = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] api_rate_limit                 = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[73022]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] auth_strategy                  = keystone {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] az_cache_duration              = 3600 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_availability_zone      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_host                   = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_name                   = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_stats_polling_interval = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backup_api_class               = cinder.backup.api.API {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backup_name_template           = backup-%s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backup_use_same_host           = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backup_use_temp_snapshot       = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] chap_password                  = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] chap_username                  =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_internal_tenant_project_id = acb01cd8828e4790836f2d9ead5d394a {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_internal_tenant_user_id = 6feaa56c036b46c19900026b85de437c {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cloned_volume_same_az          = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cluster                        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] compression_format             = gzip {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] compute_api_class              = cinder.compute.nova.API {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] config_dir                     = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] config_source                  = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] control_exchange               = openstack {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] debug                          = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] default_availability_zone      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] default_group_type             = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] default_volume_type            = lvmdriver-1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] disk_geometry                  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] driver_client_cert             = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] driver_client_cert_key         = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] driver_data_namespace          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] driver_ssl_cert_path           = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] driver_ssl_cert_verify         = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] driver_use_ssl                 = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] enable_force_upload            = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] enable_new_services            = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] enable_unsupported_driver      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] enforce_multipath_for_image_xfer = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] filter_function                = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_api_insecure            = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_api_servers             = ['http://192.168.122.50/image'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_api_ssl_compression     = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_ca_certificates_file    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_catalog_info            = image:glance:publicURL {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_certfile                = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_keyfile                 = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_num_retries             = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance_request_timeout         = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] goodness_function              = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] graceful_shutdown_timeout      = 5 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] group_api_class                = cinder.group.api.API {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] host                           = devstack {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_compress_on_upload       = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_conversion_address_space_limit = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_conversion_cpu_limit     = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_conversion_disable       = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_upload_use_cinder_backend = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_upload_use_internal_tenant = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_volume_cache_enabled     = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_volume_cache_max_count   = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] image_volume_cache_max_size_gb = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] init_host_max_objects_retrieval = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] instance_format                = [instance: %(uuid)s]  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] iscsi_target_flags             =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] iscsi_write_cache              = on {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] iser_helper                    = tgtadm {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] iser_ip_address                = 192.168.122.50 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] iser_port                      = 3260 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_color                      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_config_append              = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_dir                        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_file                       = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_options                    = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_rotate_interval            = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_rotate_interval_type       = days {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] log_rotation_type              = none {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] max_age                        = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] max_logfile_count              = 30 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] max_logfile_size_mb            = 200 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] max_over_subscription_ratio    = 20.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] message_reap_interval          = 86400 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] message_ttl                    = 2592000 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] migration_create_volume_timeout_secs = 300 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] monkey_patch                   = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] monkey_patch_modules           = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] my_ip                          = 192.168.122.50 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] no_snapshot_gb_quota           = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] num_iser_scan_tries            = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] num_shell_tries                = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] num_volume_device_scan_tries   = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] nvmeof_conn_info_version       = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] nvmet_ns_id                    = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] nvmet_port_id                  = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_max_limit                = 1000 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_volume_ext_list          = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_volume_listen_port       = 8776 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_volume_use_ssl           = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] osapi_volume_workers           = 2 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] per_volume_size_limit          = -1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] periodic_fuzzy_delay           = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] periodic_interval              = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] public_endpoint                = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[73022]: INFO cinder.volume.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] publish_errors                 = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_backup_gigabytes         = 1000 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_backups                  = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_gigabytes                = 1000 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_groups                   = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_snapshots                = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] quota_volumes                  = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] rate_limit_burst               = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] rate_limit_except_level        = CRITICAL {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] rate_limit_interval            = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] reinit_driver_count            = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] replication_device             = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] report_discard_supported       = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] report_interval                = 120 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] reservation_clean_interval     = 86400 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] reservation_expire             = 86400 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] reserved_image_namespaces      = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] reserved_percentage            = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] rpc_response_timeout           = 120 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] run_external_periodic_tasks    = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] scst_target_driver             = iscsi {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] scst_target_iqn_name           = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_down_time              = 720 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] shell_completion               = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] snapshot_name_template         = snapshot-%s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] snapshot_same_host             = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] split_loggers                  = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] state_path                     = /opt/stack/data/cinder {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] storage_availability_zone      = nova {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] storage_protocol               = iSCSI {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] syslog_log_facility            = LOG_USER {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] target_helper                  = lioadm {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] target_ip_address              = 192.168.122.50 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] target_port                    = 3260 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] target_protocol                = iscsi {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] target_secondary_ip_addresses  = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] trace_flags                    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] transport_url                  = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] until_refresh                  = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_chap_auth                  = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_default_quota_class        = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_journal                    = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_json                       = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_multipath_for_image_xfer   = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_stderr                     = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] use_syslog                     = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] verify_glance_signatures       = enabled {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_api_class               = cinder.volume.api.API {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_backend_name            = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_clear                   = zero {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_clear_ionice            = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_clear_size              = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_copy_bps_limit          = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_dd_blocksize            = 1M {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_name_template           = volume-%s {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_service_inithost_offload = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volume_usage_audit_period      = month {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] zoning_mode                    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_concurrency.disable_process_locking = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.admin_password = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.admin_token = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.admin_user  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_port   = 35357 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_protocol = https {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_section = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_type   = password {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_uri    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.auth_version = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.cache       = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.certfile    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.delay_auth_decision = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.http_connect_timeout = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.identity_uri = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.include_service_catalog = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.insecure    = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.interface   = public {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.keyfile     = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_password =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcache_username =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.region_name = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.service_token_roles_required = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.service_type = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.token_cache_time = 300 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.backend                  = dogpile.cache.null {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.backend_argument         = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.backend_expiration_time  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.config_prefix            = cache.oslo {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.debug_cache_backend      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.enable_retry_client      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.enable_socket_keepalive  = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.enabled                  = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.enforce_fips_mode        = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.expiration_time          = 600 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.hashclient_retry_attempts = 2 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_dead_retry      = 300 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_pool_maxsize    = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_sasl_enabled    = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.password                 = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.proxies                  = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.redis_db                 = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.redis_sentinel_service_name = mymaster {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.redis_server             = localhost:6379 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.retry_attempts           = 2 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.retry_delay              = 0.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.socket_keepalive_count   = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.socket_keepalive_idle    = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.socket_keepalive_interval = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.socket_timeout           = 1.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.tls_allowed_ciphers      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.tls_cafile               = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.tls_certfile             = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.tls_enabled              = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.tls_keyfile              = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cache.username                 = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] coordination.backend_url       = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.asyncio_connection    = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.asyncio_slave_connection = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.backend               = sqlalchemy {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.connection            = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.connection_debug      = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.connection_parameters =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.connection_recycle_time = 3600 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.connection_trace      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.db_inc_retry_interval = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.db_max_retries        = 20 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.db_max_retry_interval = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.db_retry_interval     = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.max_overflow          = 50 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.max_pool_size         = 5 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.max_retries           = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.mysql_wsrep_sync_wait = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.pool_timeout          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.retry_interval        = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.slave_connection      = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.sqlite_synchronous    = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.synchronous_reader    = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] database.use_db_reconnect      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.connection_string     = messaging:// {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.enabled               = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.es_doc_type           = notification {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.es_scroll_size        = 10000 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.es_scroll_time        = 2m {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.filter_error_trace    = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.hmac_keys             = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.sentinel_service_name = mymaster {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.socket_timeout        = 0.1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.trace_requests        = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler.trace_sqlalchemy      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler_jaeger.process_tags   = {} {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler_jaeger.service_name_prefix = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] profiler_otlp.service_name_prefix = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.enforce_new_defaults = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: WARNING oslo_config.cfg [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.enforce_scope      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.policy_default_rule = default {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.policy_file        = policy.yaml {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.group          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.helper_command = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] privsep_osbrick.user           = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.group         = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.helper_command = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] cinder_sys_admin.user          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.auth_section      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.auth_type         = password {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.cafile            = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.certfile          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.collect_timing    = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack sudo[73026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.insecure          = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack sudo[73026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.keyfile           = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.send_service_user_token = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.split_loggers     = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] service_user.timeout           = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.auth_section            = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.auth_type               = password {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.certfile                = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.collect_timing          = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.insecure                = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.keyfile                 = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.region_name             = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.split_loggers           = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] glance.timeout                 = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.backend_availability_zone = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.chap_password = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.chap_username =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.disk_geometry = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.driver_client_cert = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.driver_client_cert_key = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.driver_data_namespace = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.driver_use_ssl = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.enable_unsupported_driver = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.extra_capabilities = {} {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.filter_function = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.goodness_function = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.iscsi_target_flags =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.iscsi_write_cache = on {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.iser_helper   = tgtadm {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.iser_port     = 3260 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.lvm_share_target = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.lvm_type      = auto {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.num_shell_tries = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.nvmet_port_id = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.replication_device = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.report_discard_supported = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.reserved_percentage = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.scst_target_driver = iscsi {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.scst_target_iqn_name = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.storage_protocol = iSCSI {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.target_helper = tgtadm {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.target_port   = 3260 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.target_protocol = iscsi {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.trace_flags   = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.unique_fqdn_network = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.use_chap_auth = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_backend_name = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_clear  = zero {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_clear_ionice = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_clear_size = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_reports.file_event_handler = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_reports.log_dir           = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.backend_availability_zone = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.backend_host       = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.chap_password      = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.chap_username      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.disk_geometry      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.driver_client_cert = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.driver_data_namespace = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.extra_capabilities = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.filter_function    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.goodness_function  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.iser_helper        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.iser_ip_address    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.iser_port          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.iser_target_prefix = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.lvm_share_target   = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.lvm_type           = auto {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.num_shell_tries    = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.replication_device = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.report_discard_supported = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.reserved_percentage = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.scst_target_driver = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.storage_protocol   = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.target_helper      = lioadm {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.target_ip_address  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.target_port        = 3260 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.trace_flags        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.use_chap_auth      = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_clear       = zero {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_clear_size  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] lvmdriver-1.volumes_dir        = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.ssl      = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_notifications.driver = [] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_notifications.retry = -1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] key_manager.fixed_key          = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.barbican_api_version  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.barbican_endpoint     = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.barbican_endpoint_type = public {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.barbican_region_name  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.cafile                = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.certfile              = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.collect_timing        = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.insecure              = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.keyfile               = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.number_of_retries     = 60 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.retry_delay           = 1 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.send_service_user_token = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.split_loggers         = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.timeout               = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.verify_ssl            = True {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican.verify_ssl_path       = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.auth_section = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.auth_type = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.cafile   = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.certfile = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.collect_timing = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.insecure = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.keyfile  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.split_loggers = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] barbican_service_user.timeout  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.approle_role_id          = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.approle_secret_id        = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.kv_mountpoint            = secret {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.kv_path                  = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.kv_version               = 2 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.namespace                = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.root_token_id            = **** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.ssl_ca_crt_file          = None {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.timeout                  = 60.0 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.use_ssl                  = False {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:34:57 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] ******************************************************************************** {{(pid=72916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 10:34:58 devstack sudo[73026]: pam_unix(sudo:session): session closed for user root
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:58 devstack sudo[73036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:34:58 devstack sudo[73036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:34:58 devstack sudo[73036]: pam_unix(sudo:session): session closed for user root
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.490s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:34:58 devstack cinder-volume[73022]: INFO cinder.brick.local_dev.lvm [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:58 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:58 devstack sudo[73250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:34:58 devstack sudo[73250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:34:59 devstack sudo[73250]: pam_unix(sudo:session): session closed for user root
Apr 09 10:34:59 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:34:59 devstack cinder-volume[73022]: DEBUG cinder.brick.local_dev.lvm [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73022) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 09 10:34:59 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:34:59 devstack sudo[73435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:34:59 devstack sudo[73435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:00 devstack sudo[73435]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.888s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:00 devstack sudo[73628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:00 devstack sudo[73628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:00 devstack sudo[73628]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.526s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:00 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:00 devstack sudo[73717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 09 10:35:00 devstack sudo[73717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:01 devstack sudo[73717]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:01 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.428s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:01 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:01 devstack sudo[73721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:35:01 devstack sudo[73721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:01 devstack sudo[73721]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:01 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:01 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:01 devstack sudo[73724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:35:01 devstack sudo[73724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:01 devstack sudo[73724]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:01 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:01 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:01 devstack sudo[73732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:01 devstack sudo[73732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:02 devstack sudo[73732]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:02 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:02 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:02 devstack sudo[73736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:02 devstack sudo[73736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:02 devstack sudo[73736]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:02 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:02 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:02 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:02 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:02 devstack sudo[73742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:02 devstack sudo[73742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:03 devstack sudo[73742]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:03 devstack cinder-volume[73022]: INFO cinder.volume.drivers.lvm [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:03 devstack sudo[73746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:03 devstack sudo[73746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:03 devstack sudo[73746]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG cinder.volume.drivers.lvm [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Updating volume stats {{(pid=73022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 10:35:03 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:03 devstack sudo[73806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:35:03 devstack sudo[73806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:04 devstack sudo[73806]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:04 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:04 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:04 devstack sudo[73870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:04 devstack sudo[73870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:04 devstack sudo[73870]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:04 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:04 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:04 devstack sudo[74011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:04 devstack sudo[74011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:05 devstack sudo[74011]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:05 devstack sudo[74014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:05 devstack sudo[74014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:05 devstack sudo[74014]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:05 devstack cinder-volume[73022]: INFO cinder.volume.driver [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG cinder.volume.driver [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73022) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG oslo_db.sqlalchemy.engines [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG dbcounter [-] [73022] Writer thread running {{(pid=73022) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG cinder.db.sqlalchemy.api [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Building query based on filter {{(pid=73022) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG cinder.image.image_utils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73022) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 10:35:05 devstack cinder-volume[73022]: INFO cinder.keymgr.migration [None req-2465c431-f28b-4b7d-b8fa-608705dae67c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG cinder.volume.drivers.lvm [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Updating volume stats {{(pid=73022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 10:35:05 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:05 devstack sudo[74023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:35:05 devstack sudo[74023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:06 devstack sudo[74023]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:06 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:06 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:06 devstack sudo[74027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:06 devstack sudo[74027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:06 devstack sudo[74027]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:06 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:06 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:06 devstack sudo[74030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:06 devstack sudo[74030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:07 devstack sudo[74030]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:07 devstack sudo[74033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:07 devstack sudo[74033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:07 devstack cinder-volume[72916]: DEBUG dbcounter [-] [72916] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72916) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:35:07 devstack sudo[74033]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG cinder.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Notifying Schedulers of capabilities ... {{(pid=73022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:35:07 devstack cinder-volume[73022]: INFO cinder.volume.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Driver initialization completed successfully.
Apr 09 10:35:07 devstack cinder-volume[73022]: INFO cinder.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Initiating service 2 cleanup
Apr 09 10:35:07 devstack cinder-volume[73022]: INFO cinder.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Service 2 cleanup completed.
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG cinder.service [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Creating RPC server for service cinder-volume {{(pid=73022) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG cinder.service [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73022) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 10:35:07 devstack cinder-volume[73022]: INFO cinder.volume.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG cinder.volume.drivers.lvm [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Updating volume stats {{(pid=73022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 10:35:07 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:07 devstack sudo[74042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:35:07 devstack sudo[74042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:08 devstack sudo[74042]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:08 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:08 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:08 devstack sudo[74047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:08 devstack sudo[74047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:08 devstack sudo[74047]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:08 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:08 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:08 devstack sudo[74050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:35:08 devstack sudo[74050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:09 devstack sudo[74050]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:09 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:09 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:35:09 devstack sudo[74107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:35:09 devstack sudo[74107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:35:09 devstack sudo[74107]: pam_unix(sudo:session): session closed for user root
Apr 09 10:35:09 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:35:09 devstack cinder-volume[73022]: INFO cinder.volume.manager [None req-9d68f0f8-1f6b-4cfb-a250-8212a85fdff4 None None] Driver post RPC initialization completed successfully.
Apr 09 10:35:19 devstack cinder-volume[73022]: DEBUG dbcounter [-] [73022] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73022) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:35:19 devstack cinder-volume[73022]: DEBUG dbcounter [-] [73022] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73022) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:36:27 devstack cinder-volume[73022]: DEBUG oslo_service.periodic_task [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73022) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:36:27 devstack cinder-volume[73022]: DEBUG cinder.volume.drivers.lvm [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Updating volume stats {{(pid=73022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 10:36:27 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:36:27 devstack sudo[78959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:36:27 devstack sudo[78959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:36:28 devstack sudo[78959]: pam_unix(sudo:session): session closed for user root
Apr 09 10:36:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:36:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:36:28 devstack sudo[78964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:36:28 devstack sudo[78964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:36:28 devstack sudo[78964]: pam_unix(sudo:session): session closed for user root
Apr 09 10:36:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:36:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:36:28 devstack sudo[78970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:36:28 devstack sudo[78970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:36:28 devstack sudo[78970]: pam_unix(sudo:session): session closed for user root
Apr 09 10:36:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:36:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:36:28 devstack sudo[78973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:36:28 devstack sudo[78973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:36:29 devstack sudo[78973]: pam_unix(sudo:session): session closed for user root
Apr 09 10:36:29 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:36:29 devstack cinder-volume[73022]: DEBUG cinder.manager [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Notifying Schedulers of capabilities ... {{(pid=73022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:37:19 devstack cinder-volume[73022]: DEBUG dbcounter [-] [73022] Writing DB stats cinder:SELECT=1 {{(pid=73022) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:37:19 devstack cinder-volume[73022]: DEBUG dbcounter [-] [73022] Writing DB stats cinder:UPDATE=1 {{(pid=73022) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:37:27 devstack cinder-volume[73022]: DEBUG oslo_service.periodic_task [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73022) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:37:27 devstack cinder-volume[73022]: DEBUG cinder.volume.drivers.lvm [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Updating volume stats {{(pid=73022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 10:37:27 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:37:27 devstack sudo[80857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:37:27 devstack sudo[80857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:37:28 devstack sudo[80857]: pam_unix(sudo:session): session closed for user root
Apr 09 10:37:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:37:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:37:28 devstack sudo[80871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:37:28 devstack sudo[80871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:37:28 devstack sudo[80871]: pam_unix(sudo:session): session closed for user root
Apr 09 10:37:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:37:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:37:28 devstack sudo[80874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:37:28 devstack sudo[80874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:37:28 devstack sudo[80874]: pam_unix(sudo:session): session closed for user root
Apr 09 10:37:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:37:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:37:28 devstack sudo[80878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:37:28 devstack sudo[80878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:37:29 devstack sudo[80878]: pam_unix(sudo:session): session closed for user root
Apr 09 10:37:29 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:37:29 devstack cinder-volume[73022]: DEBUG cinder.manager [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Notifying Schedulers of capabilities ... {{(pid=73022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:38:27 devstack cinder-volume[73022]: DEBUG oslo_service.periodic_task [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73022) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:38:27 devstack cinder-volume[73022]: DEBUG cinder.volume.drivers.lvm [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Updating volume stats {{(pid=73022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 10:38:27 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:27 devstack sudo[81985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 10:38:27 devstack sudo[81985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:28 devstack sudo[81985]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:28 devstack sudo[81997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:38:28 devstack sudo[81997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:28 devstack sudo[81997]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:28 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:28 devstack sudo[82068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 10:38:28 devstack sudo[82068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:29 devstack sudo[82068]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:29 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:29 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:29 devstack sudo[82085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 10:38:29 devstack sudo[82085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:29 devstack sudo[82085]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:29 devstack cinder-volume[73022]: DEBUG oslo_concurrency.processutils [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73022) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:29 devstack cinder-volume[73022]: DEBUG cinder.manager [None req-6d119fa8-79f1-4593-9785-7915be9ec061 None None] Notifying Schedulers of capabilities ... {{(pid=73022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:38:31 devstack cinder-volume[72916]: INFO oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Caught SIGTERM, stopping children
Apr 09 10:38:31 devstack cinder-volume[72916]: DEBUG oslo_concurrency.lockutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Acquiring lock "singleton_lock" {{(pid=72916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:38:31 devstack cinder-volume[72916]: DEBUG oslo_concurrency.lockutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Acquired lock "singleton_lock" {{(pid=72916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:38:31 devstack cinder-volume[72916]: DEBUG oslo_concurrency.lockutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Releasing lock "singleton_lock" {{(pid=72916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:38:31 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Stop services. {{(pid=72916) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 09 10:38:31 devstack cinder-volume[72916]: DEBUG oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Killing children. {{(pid=72916) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 09 10:38:31 devstack cinder-volume[72916]: INFO oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Waiting on 1 children to exit
Apr 09 10:38:32 devstack cinder-volume[73022]: DEBUG oslo_concurrency.lockutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Acquiring lock "singleton_lock" {{(pid=73022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:38:32 devstack cinder-volume[73022]: DEBUG oslo_concurrency.lockutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Acquired lock "singleton_lock" {{(pid=73022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:38:32 devstack cinder-volume[73022]: DEBUG oslo_concurrency.lockutils [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Releasing lock "singleton_lock" {{(pid=73022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:38:32 devstack cinder-volume[73022]: WARNING amqp [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 10:38:32 devstack cinder-volume[73022]: WARNING amqp [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 10:38:32 devstack cinder-volume[72916]: INFO oslo_service.backend._eventlet.service [None req-1ffc84c9-0895-4de2-823f-8fe293ebce0e None None] Child 73022 exited with status 0
Apr 09 10:38:32 devstack cinder-volume[82234]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 10:38:32 devstack cinder-volume[82234]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 10:38:32 devstack cinder-volume[82234]: we strongly recommend against using it for new projects.
Apr 09 10:38:32 devstack cinder-volume[82234]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 10:38:32 devstack cinder-volume[82234]: framework.  For more detail see
Apr 09 10:38:32 devstack cinder-volume[82234]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 10:38:32 devstack cinder-volume[82234]:   import eventlet  # noqa
Apr 09 10:38:34 devstack cinder-volume[82234]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82234) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:38:34 devstack cinder-volume[82234]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82234) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:38:34 devstack cinder-volume[82234]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82234) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO dbcounter [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Registered counter for database cinder
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_db.sqlalchemy.engines [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG dbcounter [-] [82234] Writer thread running {{(pid=82234) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO cinder.rpc [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO cinder.rpc [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_db.sqlalchemy.engines [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO cinder.volume.manager [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Determined volume DB was empty at startup.
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG cinder.volume.manager [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82234) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO cinder.volume.manager [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 09 10:38:35 devstack cinder-volume[82234]: WARNING stevedore.named [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 10:38:35 devstack cinder-volume[82234]: WARNING castellan.key_manager [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:38:35 devstack cinder-volume[82234]: WARNING cinder.keymgr.conf_key_mgr [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO cinder.volume.manager [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_db.sqlalchemy.engines [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:35 devstack cinder-volume[82234]: INFO oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Starting 1 workers
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Started child 82351 {{(pid=82234) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Full set of CONF: {{(pid=82234) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] ******************************************************************************** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Configuration options gathered from: {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] ================================================================================ {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] allow_availability_zone_fallback = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] allow_compression_on_image_upload = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] allowed_direct_url_schemes     = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] api_rate_limit                 = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] auth_strategy                  = keystone {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_availability_zone      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_host                   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_name                   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_stats_polling_interval = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backup_api_class               = cinder.backup.api.API {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backup_name_template           = backup-%s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backup_use_same_host           = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backup_use_temp_snapshot       = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] chap_password                  = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] chap_username                  =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82351]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_internal_tenant_project_id = acb01cd8828e4790836f2d9ead5d394a {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_internal_tenant_user_id = 6feaa56c036b46c19900026b85de437c {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cluster                        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] compression_format             = gzip {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] compute_api_class              = cinder.compute.nova.API {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] config_dir                     = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] config_source                  = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] control_exchange               = openstack {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] debug                          = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] default_availability_zone      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] default_group_type             = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] default_volume_type            = QuobyteHD {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] disk_geometry                  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] driver_client_cert             = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] driver_client_cert_key         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] driver_data_namespace          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] driver_ssl_cert_path           = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] driver_ssl_cert_verify         = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] driver_use_ssl                 = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] enable_new_services            = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] enable_unsupported_driver      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] enabled_backends               = ['QuobyteHD'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] enforce_multipath_for_image_xfer = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] filter_function                = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_api_insecure            = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_api_servers             = ['http://192.168.122.50/image'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_api_ssl_compression     = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_ca_certificates_file    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_catalog_info            = image:glance:publicURL {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_certfile                = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_keyfile                 = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_num_retries             = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance_request_timeout         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] goodness_function              = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] graceful_shutdown_timeout      = 5 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] group_api_class                = cinder.group.api.API {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] host                           = devstack {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_compress_on_upload       = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_conversion_address_space_limit = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_conversion_cpu_limit     = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_conversion_disable       = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_upload_use_cinder_backend = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_upload_use_internal_tenant = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82351]: INFO cinder.volume.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_volume_cache_enabled     = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_volume_cache_max_count   = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.remotefs [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82351) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] image_volume_cache_max_size_gb = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] init_host_max_objects_retrieval = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] instance_format                = [instance: %(uuid)s]  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] iscsi_target_flags             =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] iscsi_write_cache              = on {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] iser_helper                    = tgtadm {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] iser_ip_address                = 192.168.122.50 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] iser_port                      = 3260 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_color                      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_config_append              = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_dir                        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_file                       = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_options                    = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_rotate_interval            = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_rotate_interval_type       = days {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] log_rotation_type              = none {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] max_age                        = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] max_logfile_count              = 30 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] max_logfile_size_mb            = 200 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] max_over_subscription_ratio    = 20.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] message_reap_interval          = 86400 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] message_ttl                    = 2592000 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] migration_create_volume_timeout_secs = 300 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] monkey_patch                   = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] monkey_patch_modules           = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] my_ip                          = 192.168.122.50 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] no_snapshot_gb_quota           = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] num_iser_scan_tries            = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] num_shell_tries                = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] num_volume_device_scan_tries   = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] nvmeof_conn_info_version       = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] nvmet_ns_id                    = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] nvmet_port_id                  = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_max_limit                = 1000 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_volume_ext_list          = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_volume_listen_port       = 8776 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_volume_use_ssl           = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] osapi_volume_workers           = 2 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] per_volume_size_limit          = -1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] periodic_fuzzy_delay           = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] periodic_interval              = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] public_endpoint                = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] publish_errors                 = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_backup_gigabytes         = 1000 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_backups                  = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_gigabytes                = 1000 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_groups                   = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_snapshots                = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] quota_volumes                  = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] rate_limit_burst               = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] rate_limit_except_level        = CRITICAL {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] rate_limit_interval            = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] reinit_driver_count            = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] replication_device             = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] report_discard_supported       = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] report_interval                = 120 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] reservation_clean_interval     = 86400 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] reservation_expire             = 86400 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] reserved_image_namespaces      = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] reserved_percentage            = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] rpc_response_timeout           = 120 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] run_external_periodic_tasks    = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] scst_target_driver             = iscsi {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] scst_target_iqn_name           = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_down_time              = 720 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] shell_completion               = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] snapshot_name_template         = snapshot-%s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] split_loggers                  = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] state_path                     = /opt/stack/data/cinder {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] storage_availability_zone      = nova {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] storage_protocol               = iSCSI {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] syslog_log_facility            = LOG_USER {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] target_helper                  = lioadm {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] target_ip_address              = 192.168.122.50 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] target_port                    = 3260 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] target_protocol                = iscsi {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] target_secondary_ip_addresses  = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] trace_flags                    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] transport_url                  = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] until_refresh                  = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_chap_auth                  = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_default_quota_class        = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_journal                    = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_json                       = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_multipath_for_image_xfer   = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_stderr                     = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] use_syslog                     = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] verify_glance_signatures       = enabled {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_api_class               = cinder.volume.api.API {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_backend_name            = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_clear                   = zero {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82351) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 09 10:38:35 devstack cinder-volume[82351]: WARNING cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 09 10:38:35 devstack cinder-volume[82351]: WARNING cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_clear_ionice            = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_clear_size              = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Running cmd (subprocess): mount.quobyte {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_copy_bps_limit          = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_dd_blocksize            = 1M {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_name_template           = volume-%s {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_service_inithost_offload = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volume_usage_audit_period      = month {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] zoning_mode                    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_concurrency.disable_process_locking = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.admin_password = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.admin_token = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.admin_user  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_port   = 35357 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_protocol = https {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_section = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_type   = password {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_uri    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.auth_version = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.cache       = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.certfile    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.identity_uri = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.include_service_catalog = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.insecure    = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.interface   = public {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.keyfile     = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_password =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcache_username =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.region_name = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.service_token_roles_required = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.service_type = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.backend                  = dogpile.cache.null {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.backend_argument         = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.backend_expiration_time  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.config_prefix            = cache.oslo {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.debug_cache_backend      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.enable_retry_client      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.enable_socket_keepalive  = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.enabled                  = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.enforce_fips_mode        = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.expiration_time          = 600 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.hashclient_retry_attempts = 2 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_dead_retry      = 300 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_pool_maxsize    = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_sasl_enabled    = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.password                 = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.proxies                  = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.redis_db                 = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.redis_server             = localhost:6379 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.retry_attempts           = 2 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.retry_delay              = 0.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.socket_keepalive_count   = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.socket_keepalive_idle    = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.socket_keepalive_interval = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.socket_timeout           = 1.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.tls_allowed_ciphers      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.tls_cafile               = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.tls_certfile             = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.tls_enabled              = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.tls_keyfile              = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cache.username                 = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] coordination.backend_url       = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.asyncio_connection    = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.asyncio_slave_connection = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.backend               = sqlalchemy {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.connection            = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.connection_debug      = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.connection_parameters =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.connection_recycle_time = 3600 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.connection_trace      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.db_inc_retry_interval = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.db_max_retries        = 20 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.db_max_retry_interval = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.db_retry_interval     = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.max_overflow          = 50 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.max_pool_size         = 5 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.max_retries           = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.mysql_wsrep_sync_wait = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.pool_timeout          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.retry_interval        = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.slave_connection      = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.sqlite_synchronous    = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.synchronous_reader    = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] database.use_db_reconnect      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.connection_string     = messaging:// {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.enabled               = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.es_doc_type           = notification {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.es_scroll_size        = 10000 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.es_scroll_time        = 2m {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.filter_error_trace    = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.hmac_keys             = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.sentinel_service_name = mymaster {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.socket_timeout        = 0.1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.trace_requests        = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler.trace_sqlalchemy      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler_jaeger.process_tags   = {} {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler_jaeger.service_name_prefix = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] profiler_otlp.service_name_prefix = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.enforce_new_defaults = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: WARNING oslo_config.cfg [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.enforce_scope      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.policy_default_rule = default {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.policy_file        = policy.yaml {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack quobyte-client[82354]: Reading configuration file: /etc/quobyte/client.cfg
Apr 09 10:38:35 devstack quobyte-client[82354]: Invalid parameters found, error: missing mount point.
Apr 09 10:38:35 devstack quobyte-client[82354]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 09 10:38:35 devstack quobyte-client[82354]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.group          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.helper_command = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] privsep_osbrick.user           = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.group         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.helper_command = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] cinder_sys_admin.user          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.auth_section      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.auth_type         = password {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.cafile            = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.certfile          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.collect_timing    = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.insecure          = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.keyfile           = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.send_service_user_token = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.split_loggers     = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] service_user.timeout           = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.auth_section            = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.auth_type               = password {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.certfile                = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.collect_timing          = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.insecure                = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.keyfile                 = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82351) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:38:35 devstack cinder-volume[82351]: INFO cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 ...
Apr 09 10:38:35 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 -c /etc/quobyte/client-cinder.cfg {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.region_name             = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.split_loggers           = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] glance.timeout                 = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.backend_availability_zone = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.chap_password = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.chap_username =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.disk_geometry = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.driver_client_cert = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.driver_client_cert_key = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.driver_data_namespace = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:35 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.driver_use_ssl = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.extra_capabilities = {} {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.filter_function = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.goodness_function = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.iscsi_target_flags =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.iscsi_write_cache = on {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.iser_helper   = tgtadm {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack sudo[82355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 -c /etc/quobyte/client-cinder.cfg
Apr 09 10:38:36 devstack sudo[82355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.iser_port     = 3260 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_host      =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_login     = admin {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_mount_options = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_password  = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_private_key =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_share_path =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.num_shell_tries = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_client_cfg = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.quobyte_volume_url = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.replication_device = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.report_discard_supported = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.reserved_percentage = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.target_helper = tgtadm {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.target_port   = 3260 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.target_protocol = iscsi {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.trace_flags   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.unique_fqdn_network = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.use_chap_auth = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_backend_name = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_clear  = zero {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_clear_ionice = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_clear_size = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_reports.file_event_handler = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_reports.log_dir           = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.backend_availability_zone = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.backend_host         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.chap_password        = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.chap_username        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.chiscsi_conf         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.disk_geometry        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.driver_client_cert   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.driver_client_cert_key = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.driver_data_namespace = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.driver_use_ssl       = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.extra_capabilities   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.filter_function      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.goodness_function    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.iser_helper          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.iser_ip_address      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.iser_port            = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.iser_target_prefix   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_host             = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_login            = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_mount_options    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_password         = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_private_key      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_share_path       = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_ssh_port         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.num_shell_tries      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.nvmet_port_id        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.replication_device   = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.report_discard_supported = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.reserved_percentage  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.scst_target_driver   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.storage_protocol     = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.target_helper        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.target_ip_address    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.target_port          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.target_prefix        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.target_protocol      = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.trace_flags          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.use_chap_auth        = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_clear         = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_clear_size    = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] QuobyteHD.volumes_dir          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.ssl      = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_notifications.driver = [] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_notifications.retry = -1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] key_manager.fixed_key          = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.barbican_api_version  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.barbican_endpoint     = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.barbican_endpoint_type = public {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.barbican_region_name  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.cafile                = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.certfile              = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.collect_timing        = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.insecure              = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.keyfile               = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.number_of_retries     = 60 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.retry_delay           = 1 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.send_service_user_token = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.split_loggers         = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.timeout               = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.verify_ssl            = True {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican.verify_ssl_path       = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.auth_section = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.auth_type = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.cafile   = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.certfile = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.collect_timing = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.insecure = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.keyfile  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.split_loggers = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] barbican_service_user.timeout  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.approle_role_id          = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.approle_secret_id        = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.kv_mountpoint            = secret {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.kv_path                  = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.kv_version               = 2 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.namespace                = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.root_token_id            = **** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.ssl_ca_crt_file          = None {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.timeout                  = 60.0 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.use_ssl                  = False {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:36 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] ******************************************************************************** {{(pid=82234) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 10:38:36 devstack sudo[82355]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.534s {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:36 devstack cinder-volume[82351]: INFO cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 succeeded
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82351) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.557s {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:36 devstack sudo[82425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:38:36 devstack sudo[82425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:36 devstack sudo[82425]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.390s {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:36 devstack cinder-volume[82351]: INFO cinder.volume.driver [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG cinder.volume.driver [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82351) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG oslo_db.sqlalchemy.engines [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG dbcounter [-] [82351] Writer thread running {{(pid=82351) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG cinder.db.sqlalchemy.api [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Building query based on filter {{(pid=82351) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 10:38:36 devstack cinder-volume[82351]: DEBUG cinder.image.image_utils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82351) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 10:38:36 devstack cinder-volume[82351]: INFO cinder.keymgr.migration [None req-94cb60c0-483c-484d-b5cf-48ab35f4e913 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82351) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82351) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:37 devstack sudo[82428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:38:37 devstack sudo[82428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:37 devstack sudo[82428]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.387s {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Notifying Schedulers of capabilities ... {{(pid=82351) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:38:37 devstack cinder-volume[82351]: INFO cinder.volume.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Driver initialization completed successfully.
Apr 09 10:38:37 devstack cinder-volume[82351]: INFO cinder.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Initiating service 3 cleanup
Apr 09 10:38:37 devstack cinder-volume[82351]: INFO cinder.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Service 3 cleanup completed.
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.service [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Creating RPC server for service cinder-volume {{(pid=82351) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.service [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82351) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 10:38:37 devstack cinder-volume[82351]: INFO cinder.volume.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82351) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG cinder.volume.drivers.quobyte [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82351) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82351) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:37 devstack sudo[82433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:38:37 devstack sudo[82433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:37 devstack sudo[82433]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:37 devstack cinder-volume[82351]: DEBUG oslo_concurrency.processutils [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.419s {{(pid=82351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:37 devstack cinder-volume[82351]: INFO cinder.volume.manager [None req-a91d9483-bfd9-4eb2-86b9-5f7d82c0e048 None None] Driver post RPC initialization completed successfully.
Apr 09 10:38:40 devstack cinder-volume[82234]: INFO oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Caught SIGTERM, stopping children
Apr 09 10:38:40 devstack cinder-volume[82234]: DEBUG oslo_concurrency.lockutils [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Acquiring lock "singleton_lock" {{(pid=82234) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:38:40 devstack cinder-volume[82234]: DEBUG oslo_concurrency.lockutils [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Acquired lock "singleton_lock" {{(pid=82234) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:38:40 devstack cinder-volume[82234]: DEBUG oslo_concurrency.lockutils [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Releasing lock "singleton_lock" {{(pid=82234) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:38:40 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Stop services. {{(pid=82234) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 09 10:38:40 devstack cinder-volume[82234]: DEBUG oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Killing children. {{(pid=82234) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 09 10:38:40 devstack cinder-volume[82234]: INFO oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Waiting on 1 children to exit
Apr 09 10:38:41 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Acquiring lock "singleton_lock" {{(pid=82351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:38:41 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Acquired lock "singleton_lock" {{(pid=82351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:38:41 devstack cinder-volume[82351]: DEBUG oslo_concurrency.lockutils [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Releasing lock "singleton_lock" {{(pid=82351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:38:41 devstack cinder-volume[82351]: WARNING amqp [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 10:38:41 devstack cinder-volume[82351]: WARNING amqp [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 10:38:41 devstack cinder-volume[82234]: INFO oslo_service.backend._eventlet.service [None req-e073214c-8cd4-4975-950b-6c6a29c1484e None None] Child 82351 exited with status 0
Apr 09 10:38:42 devstack cinder-volume[82571]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 10:38:42 devstack cinder-volume[82571]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 10:38:42 devstack cinder-volume[82571]: we strongly recommend against using it for new projects.
Apr 09 10:38:42 devstack cinder-volume[82571]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 10:38:42 devstack cinder-volume[82571]: framework.  For more detail see
Apr 09 10:38:42 devstack cinder-volume[82571]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 10:38:42 devstack cinder-volume[82571]:   import eventlet  # noqa
Apr 09 10:38:43 devstack cinder-volume[82571]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 10:38:43 devstack cinder-volume[82571]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 10:38:43 devstack cinder-volume[82571]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 10:38:44 devstack cinder-volume[82571]: INFO dbcounter [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Registered counter for database cinder
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82571) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG dbcounter [-] [82571] Writer thread running {{(pid=82571) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 10:38:44 devstack cinder-volume[82571]: INFO cinder.rpc [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 10:38:44 devstack cinder-volume[82571]: INFO cinder.rpc [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82571) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:44 devstack cinder-volume[82571]: INFO cinder.volume.manager [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Determined volume DB was empty at startup.
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG cinder.volume.manager [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82571) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 10:38:44 devstack cinder-volume[82571]: WARNING stevedore.named [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 10:38:44 devstack cinder-volume[82571]: WARNING castellan.key_manager [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:38:44 devstack cinder-volume[82571]: WARNING cinder.keymgr.conf_key_mgr [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 10:38:44 devstack cinder-volume[82571]: INFO cinder.volume.manager [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82571) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:44 devstack cinder-volume[82571]: INFO oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Starting 1 workers
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Started child 82783 {{(pid=82571) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Full set of CONF: {{(pid=82571) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] ******************************************************************************** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Configuration options gathered from: {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] ================================================================================ {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] allow_availability_zone_fallback = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] allow_compression_on_image_upload = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] allowed_direct_url_schemes     = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] api_rate_limit                 = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] auth_strategy                  = keystone {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_availability_zone      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_host                   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_name                   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_stats_polling_interval = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backup_api_class               = cinder.backup.api.API {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backup_name_template           = backup-%s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backup_use_same_host           = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backup_use_temp_snapshot       = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] chap_password                  = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] chap_username                  =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_internal_tenant_project_id = acb01cd8828e4790836f2d9ead5d394a {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_internal_tenant_user_id = 6feaa56c036b46c19900026b85de437c {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cluster                        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] compression_format             = gzip {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] config_dir                     = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] config_source                  = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] control_exchange               = openstack {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] debug                          = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] default_availability_zone      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] default_group_type             = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] default_volume_type            = QuobyteHD {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] disk_geometry                  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] driver_client_cert             = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] driver_client_cert_key         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] driver_data_namespace          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] driver_ssl_cert_path           = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] driver_ssl_cert_verify         = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] driver_use_ssl                 = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] enable_new_services            = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] enable_unsupported_driver      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] enforce_multipath_for_image_xfer = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] filter_function                = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_api_insecure            = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_api_servers             = ['http://192.168.122.50/image'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_api_ssl_compression     = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_ca_certificates_file    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_certfile                = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_keyfile                 = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_num_retries             = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance_request_timeout         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82783]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] goodness_function              = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] graceful_shutdown_timeout      = 5 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] group_api_class                = cinder.group.api.API {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] host                           = devstack {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_compress_on_upload       = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_conversion_address_space_limit = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_conversion_cpu_limit     = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_conversion_disable       = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_upload_use_cinder_backend = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_upload_use_internal_tenant = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_volume_cache_enabled     = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_volume_cache_max_count   = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] image_volume_cache_max_size_gb = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] init_host_max_objects_retrieval = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] iscsi_target_flags             =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] iscsi_write_cache              = on {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] iser_helper                    = tgtadm {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] iser_ip_address                = 192.168.122.50 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] iser_port                      = 3260 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_color                      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_config_append              = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_dir                        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_file                       = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_options                    = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_rotate_interval            = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_rotate_interval_type       = days {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] log_rotation_type              = none {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] max_age                        = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] max_logfile_count              = 30 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] max_logfile_size_mb            = 200 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] max_over_subscription_ratio    = 20.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] message_reap_interval          = 86400 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] message_ttl                    = 2592000 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] migration_create_volume_timeout_secs = 300 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] monkey_patch                   = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] monkey_patch_modules           = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] my_ip                          = 192.168.122.50 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] no_snapshot_gb_quota           = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] num_iser_scan_tries            = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] num_shell_tries                = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] num_volume_device_scan_tries   = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] nvmeof_conn_info_version       = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] nvmet_ns_id                    = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] nvmet_port_id                  = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_max_limit                = 1000 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_volume_ext_list          = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_volume_listen_port       = 8776 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_volume_use_ssl           = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] osapi_volume_workers           = 2 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] per_volume_size_limit          = -1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] periodic_fuzzy_delay           = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] periodic_interval              = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] public_endpoint                = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] publish_errors                 = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_backup_gigabytes         = 1000 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_backups                  = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_gigabytes                = 1000 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_groups                   = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_snapshots                = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] quota_volumes                  = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] rate_limit_burst               = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] rate_limit_except_level        = CRITICAL {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] rate_limit_interval            = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] reinit_driver_count            = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] replication_device             = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] report_discard_supported       = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] report_interval                = 120 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] reservation_clean_interval     = 86400 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] reservation_expire             = 86400 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] reserved_image_namespaces      = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] reserved_percentage            = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] rpc_response_timeout           = 120 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] run_external_periodic_tasks    = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] scst_target_driver             = iscsi {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] scst_target_iqn_name           = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_down_time              = 720 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] shell_completion               = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] snapshot_name_template         = snapshot-%s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] split_loggers                  = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] state_path                     = /opt/stack/data/cinder {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] storage_availability_zone      = nova {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] storage_protocol               = iSCSI {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] syslog_log_facility            = LOG_USER {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] target_helper                  = lioadm {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] target_ip_address              = 192.168.122.50 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] target_port                    = 3260 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] target_protocol                = iscsi {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] target_secondary_ip_addresses  = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] trace_flags                    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] transport_url                  = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] until_refresh                  = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_chap_auth                  = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 09 10:38:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82783) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_default_quota_class        = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_journal                    = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_json                       = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_multipath_for_image_xfer   = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_stderr                     = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] use_syslog                     = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] verify_glance_signatures       = enabled {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_api_class               = cinder.volume.api.API {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_backend_name            = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_clear                   = zero {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_clear_ionice            = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_clear_size              = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_copy_bps_limit          = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_dd_blocksize            = 1M {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_name_template           = volume-%s {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_service_inithost_offload = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volume_usage_audit_period      = month {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] zoning_mode                    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_concurrency.disable_process_locking = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.admin_password = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.admin_token = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.admin_user  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_protocol = https {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_section = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_type   = password {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_uri    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.auth_version = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:44 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.cache       = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.certfile    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.identity_uri = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.include_service_catalog = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.insecure    = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.interface   = public {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.keyfile     = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_password =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcache_username =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.region_name = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.service_type = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.backend                  = dogpile.cache.null {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.backend_argument         = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.backend_expiration_time  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack sudo[82801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.config_prefix            = cache.oslo {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.debug_cache_backend      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.enable_retry_client      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.enable_socket_keepalive  = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.enabled                  = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.enforce_fips_mode        = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.expiration_time          = 600 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack sudo[82801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.hashclient_retry_attempts = 2 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_dead_retry      = 300 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_sasl_enabled    = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.password                 = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.proxies                  = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.redis_db                 = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.redis_server             = localhost:6379 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.retry_attempts           = 2 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.retry_delay              = 0.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.socket_keepalive_count   = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.socket_keepalive_idle    = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.socket_keepalive_interval = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.socket_timeout           = 1.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.tls_allowed_ciphers      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.tls_cafile               = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.tls_certfile             = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.tls_enabled              = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.tls_keyfile              = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cache.username                 = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] coordination.backend_url       = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.asyncio_connection    = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.asyncio_slave_connection = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.backend               = sqlalchemy {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.connection            = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.connection_debug      = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.connection_parameters =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.connection_recycle_time = 3600 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.connection_trace      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.db_inc_retry_interval = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.db_max_retries        = 20 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.db_max_retry_interval = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.db_retry_interval     = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.max_overflow          = 50 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.max_pool_size         = 5 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.max_retries           = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.mysql_wsrep_sync_wait = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.pool_timeout          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.retry_interval        = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.slave_connection      = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.sqlite_synchronous    = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.synchronous_reader    = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] database.use_db_reconnect      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.connection_string     = messaging:// {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.enabled               = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.es_doc_type           = notification {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.es_scroll_size        = 10000 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.es_scroll_time        = 2m {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.filter_error_trace    = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.hmac_keys             = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.sentinel_service_name = mymaster {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.socket_timeout        = 0.1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.trace_requests        = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler.trace_sqlalchemy      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler_jaeger.process_tags   = {} {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler_jaeger.service_name_prefix = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] profiler_otlp.service_name_prefix = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.enforce_new_defaults = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: WARNING oslo_config.cfg [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.enforce_scope      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.policy_default_rule = default {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.group          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.helper_command = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] privsep_osbrick.user           = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.group         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.helper_command = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] cinder_sys_admin.user          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.auth_section      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.auth_type         = password {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.cafile            = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.certfile          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.collect_timing    = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.insecure          = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.keyfile           = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.send_service_user_token = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.split_loggers     = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] service_user.timeout           = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.auth_section            = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.auth_type               = password {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.certfile                = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.collect_timing          = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.insecure                = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.keyfile                 = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.region_name             = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.split_loggers           = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] glance.timeout                 = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.backend_availability_zone = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.chap_password = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.chap_username =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.disk_geometry = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.driver_client_cert = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.driver_client_cert_key = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.driver_data_namespace = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.driver_use_ssl = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.extra_capabilities = {} {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.filter_function = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.goodness_function = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.iscsi_target_flags =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.iscsi_write_cache = on {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.iser_port     = 3260 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_host      =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_login     = admin {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_mount_options = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_password  = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_private_key =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_share_path =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.num_shell_tries = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.quobyte_volume_url = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.replication_device = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.report_discard_supported = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.reserved_percentage = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.target_helper = tgtadm {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.target_port   = 3260 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.target_protocol = iscsi {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.trace_flags   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.unique_fqdn_network = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.use_chap_auth = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_backend_name = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_clear  = zero {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_clear_ionice = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_clear_size = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_reports.file_event_handler = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_reports.log_dir           = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.backend_availability_zone = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.backend_host         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.chap_password        = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.chap_username        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.disk_geometry        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.driver_client_cert   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.driver_data_namespace = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.extra_capabilities   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.filter_function      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.goodness_function    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.iser_helper          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.iser_ip_address      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.iser_port            = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_host             = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_login            = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_mount_options    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_password         = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_private_key      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_share_path       = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.num_shell_tries      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.replication_device   = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.report_discard_supported = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.reserved_percentage  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.scst_target_driver   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.storage_protocol     = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.target_helper        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.target_ip_address    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.target_port          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.target_prefix        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.target_protocol      = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.trace_flags          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.use_chap_auth        = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_clear         = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_clear_size    = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] QuobyteHD.volumes_dir          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_notifications.driver = [] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_notifications.retry = -1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] key_manager.fixed_key          = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.barbican_api_version  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.barbican_endpoint     = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.barbican_endpoint_type = public {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.barbican_region_name  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.cafile                = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.certfile              = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.collect_timing        = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack sudo[82801]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.insecure              = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.keyfile               = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.number_of_retries     = 60 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.retry_delay           = 1 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.send_service_user_token = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.split_loggers         = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.timeout               = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.verify_ssl            = True {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican.verify_ssl_path       = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.auth_section = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.auth_type = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.cafile   = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.certfile = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.collect_timing = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.insecure = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.keyfile  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.split_loggers = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] barbican_service_user.timeout  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.approle_role_id          = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.approle_secret_id        = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.kv_mountpoint            = secret {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.kv_path                  = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.kv_version               = 2 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.namespace                = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.root_token_id            = **** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.ssl_ca_crt_file          = None {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.timeout                  = 60.0 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.use_ssl                  = False {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 10:38:45 devstack cinder-volume[82571]: DEBUG oslo_service.backend._eventlet.service [None req-3e9ba712-1e4e-4429-89be-a64a28eaf251 None None] ******************************************************************************** {{(pid=82571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82783) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 09 10:38:45 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 09 10:38:45 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Running cmd (subprocess): mount.quobyte {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.485s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:45 devstack cinder-volume[82783]: INFO cinder.volume.driver [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.volume.driver [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82783) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_db.sqlalchemy.engines [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writer thread running {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.db.sqlalchemy.api [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Building query based on filter {{(pid=82783) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82783) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:45 devstack cinder-volume[82783]: INFO cinder.keymgr.migration [None req-37e76d39-b134-405f-9564-90bdfd87a487 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 10:38:45 devstack sudo[82818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:38:45 devstack sudo[82818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:45 devstack sudo[82818]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.390s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:45 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:38:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Driver initialization completed successfully.
Apr 09 10:38:45 devstack cinder-volume[82783]: INFO cinder.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Initiating service 3 cleanup
Apr 09 10:38:46 devstack cinder-volume[82783]: INFO cinder.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Service 3 cleanup completed.
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG cinder.service [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Creating RPC server for service cinder-volume {{(pid=82783) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG cinder.service [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82783) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 10:38:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:38:46 devstack sudo[82823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:38:46 devstack sudo[82823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:38:46 devstack sudo[82823]: pam_unix(sudo:session): session closed for user root
Apr 09 10:38:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.396s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:38:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-05ecae08-db95-4d7c-a05a-3a3429a68908 None None] Driver post RPC initialization completed successfully.
Apr 09 10:38:54 devstack cinder-volume[82571]: DEBUG dbcounter [-] [82571] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82571) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:38:55 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=1 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:38:56 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Flow 'volume_create_manager' (5fe91aeb-c3b7-4651-b847-f0c062492ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14000ca-e5bd-4dc9-ada3-5024ebe06beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14000ca-e5bd-4dc9-ada3-5024ebe06beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-74735507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a333c09-dc90-4054-9277-a1edf782e707,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='755d80fbff32468ea05fa8e9b1f756ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:44Z,use_quota=True,user_id='6e63bbe992874f7d90b5e18e9e5b2cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14365337-0155-4ec2-8f3b-46857c55cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14365337-0155-4ec2-8f3b-46857c55cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b019027-9fa6-4fdb-bc3b-d3e30e5525fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b019027-9fa6-4fdb-bc3b-d3e30e5525fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a333c09-dc90-4054-9277-a1edf782e707', 'volume_name': 'volume-8a333c09-dc90-4054-9277-a1edf782e707', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a91fdb-fd11-4a17-a887-009b811df9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a91fdb-fd11-4a17-a887-009b811df9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6da937-0e88-4961-82a5-5e2304e5232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:44 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Volume 8a333c09-dc90-4054-9277-a1edf782e707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a333c09-dc90-4054-9277-a1edf782e707', 'volume_size': 1}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-74735507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a333c09-dc90-4054-9277-a1edf782e707,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='755d80fbff32468ea05fa8e9b1f756ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:44Z,use_quota=True,user_id='6e63bbe992874f7d90b5e18e9e5b2cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Creating volume 8a333c09-dc90-4054-9277-a1edf782e707 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:39:44 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:39:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:45 devstack sudo[83327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707 1073741824
Apr 09 10:39:45 devstack sudo[83327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Flow 'volume_create_manager' (5fd2ccb2-8506-4284-943d-1541d65b31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46374e7-3062-4d46-b851-16bc73645ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46374e7-3062-4d46-b851-16bc73645ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-233814530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662ce0b0-725b-4d2b-9484-04964ad1cfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b1ae84083b4c699b57e0e9ac1db1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:44Z,use_quota=True,user_id='39ff51a356f0429c887fc0cc3a3c86d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e391ec-434a-4a3d-8d32-777b6c7d1af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e391ec-434a-4a3d-8d32-777b6c7d1af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4998a69-7318-44f1-a3e0-ab329b307919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4998a69-7318-44f1-a3e0-ab329b307919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662ce0b0-725b-4d2b-9484-04964ad1cfc1', 'volume_name': 'volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feda5601-1af1-48f6-a9b0-510cc659551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feda5601-1af1-48f6-a9b0-510cc659551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338ce5e0-9f36-4e84-9a7c-4213399c8a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Volume 662ce0b0-725b-4d2b-9484-04964ad1cfc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1', 'volume_size': 1}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Flow 'volume_create_manager' (6bfa61a4-1d3b-46cb-93ce-8f2140bba748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d1d635-5cd9-48b7-ab84-69eb4aee7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d1d635-5cd9-48b7-ab84-69eb4aee7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:45Z,deleted=False,deleted_at=None,display_description='',display_name='4af41ba2-3505-48a6-a7f0-f734a85a7f5e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae2796b-8436-480b-9020-d384e86b87ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124433cd0a004945adf7190db8ae066c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:46Z,use_quota=True,user_id='cc72ee9be2144c4c981e3ba8dcaf4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81610ba5-d7ef-4faa-866f-e1a4e8ac447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81610ba5-d7ef-4faa-866f-e1a4e8ac447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ec0c8-d39b-4ce4-a3b6-acc79e96bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ec0c8-d39b-4ce4-a3b6-acc79e96bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae2796b-8436-480b-9020-d384e86b87ca', 'volume_name': 'volume-9ae2796b-8436-480b-9020-d384e86b87ca', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53be369e-eabd-4d7d-bc94-426967d71fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53be369e-eabd-4d7d-bc94-426967d71fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52bc2a0-7169-4d91-b2c6-e0db80d5475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:45 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Volume 9ae2796b-8436-480b-9020-d384e86b87ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae2796b-8436-480b-9020-d384e86b87ca', 'volume_size': 1}
Apr 09 10:39:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:46 devstack sudo[83327]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707 1073741824" returned: 0 in 1.752s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:46 devstack sudo[83684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707
Apr 09 10:39:46 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:47 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707" returned: 0 in 1.085s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] <== create_volume: return (2981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.983s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-233814530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662ce0b0-725b-4d2b-9484-04964ad1cfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b1ae84083b4c699b57e0e9ac1db1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:44Z,use_quota=True,user_id='39ff51a356f0429c887fc0cc3a3c86d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Creating volume 662ce0b0-725b-4d2b-9484-04964ad1cfc1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:39:47 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6da937-0e88-4961-82a5-5e2304e5232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a333c09-dc90-4054-9277-a1edf782e707', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:47 devstack sudo[83691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 1073741824
Apr 09 10:39:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6082c1-e9d2-4316-aec5-0b0c2058e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:47 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:47 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Volume volume-8a333c09-dc90-4054-9277-a1edf782e707 (8a333c09-dc90-4054-9277-a1edf782e707): created successfully
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6082c1-e9d2-4316-aec5-0b0c2058e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Flow 'volume_create_manager' (5fe91aeb-c3b7-4651-b847-f0c062492ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-cbe976a4-8eaa-4bec-a9d5-75e610ccda74 tempest-VolumesTestJSON-948372996 None] Created volume successfully.
Apr 09 10:39:48 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 1073741824" returned: 0 in 0.986s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:48 devstack sudo[83696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1
Apr 09 10:39:48 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Flow 'volume_create_manager' (8227b515-c2a3-46f8-bdb5-8159741da0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0664ba-f001-423a-a10b-88c976c7b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0664ba-f001-423a-a10b-88c976c7b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-844118927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee0eefb-b811-45de-a6d0-d2c2a1e9732e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='755d80fbff32468ea05fa8e9b1f756ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:49Z,use_quota=True,user_id='6e63bbe992874f7d90b5e18e9e5b2cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce5080-c408-44c0-a253-7fa8ba5c5973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce5080-c408-44c0-a253-7fa8ba5c5973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af98ad0-1bb5-40bd-a083-e3ac7b80c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af98ad0-1bb5-40bd-a083-e3ac7b80c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee0eefb-b811-45de-a6d0-d2c2a1e9732e', 'volume_name': 'volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466692c7-bdea-4606-94f0-c124562166bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466692c7-bdea-4606-94f0-c124562166bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8063be-5c51-41b3-b3d5-a96a25d9adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:49 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Volume 9ee0eefb-b811-45de-a6d0-d2c2a1e9732e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e', 'volume_size': 1}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:49 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1" returned: 0 in 0.664s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.711s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:45Z,deleted=False,deleted_at=None,display_description='',display_name='4af41ba2-3505-48a6-a7f0-f734a85a7f5e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae2796b-8436-480b-9020-d384e86b87ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124433cd0a004945adf7190db8ae066c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:46Z,use_quota=True,user_id='cc72ee9be2144c4c981e3ba8dcaf4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Creating volume 9ae2796b-8436-480b-9020-d384e86b87ca {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:39:49 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338ce5e0-9f36-4e84-9a7c-4213399c8a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cb109d-bd86-4c13-b1de-b3cc1c4d4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:49 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Volume volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 (662ce0b0-725b-4d2b-9484-04964ad1cfc1): created successfully
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cb109d-bd86-4c13-b1de-b3cc1c4d4c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Flow 'volume_create_manager' (5fd2ccb2-8506-4284-943d-1541d65b31aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:49 devstack sudo[83720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca 1073741824
Apr 09 10:39:49 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ae527567-c38d-46e2-9d87-3ec4f61fa3d4 tempest-DeleteServersTestJSON-863074277 None] Created volume successfully.
Apr 09 10:39:50 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca 1073741824" returned: 0 in 0.807s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:50 devstack sudo[83731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca
Apr 09 10:39:50 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:50 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca" returned: 0 in 0.491s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-844118927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee0eefb-b811-45de-a6d0-d2c2a1e9732e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='755d80fbff32468ea05fa8e9b1f756ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:49Z,use_quota=True,user_id='6e63bbe992874f7d90b5e18e9e5b2cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Creating volume 9ee0eefb-b811-45de-a6d0-d2c2a1e9732e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:39:50 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:39:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:50 devstack sudo[83735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e 1073741824
Apr 09 10:39:50 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52bc2a0-7169-4d91-b2c6-e0db80d5475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae2796b-8436-480b-9020-d384e86b87ca', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4f86be-03ec-4686-9899-cd1e7cc6bab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:51 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Volume volume-9ae2796b-8436-480b-9020-d384e86b87ca (9ae2796b-8436-480b-9020-d384e86b87ca): created successfully
Apr 09 10:39:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4f86be-03ec-4686-9899-cd1e7cc6bab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Flow 'volume_create_manager' (6bfa61a4-1d3b-46cb-93ce-8f2140bba748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-7415dcc4-38c1-4007-a9c6-a3875ad9cfce tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Created volume successfully.
Apr 09 10:39:51 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e 1073741824" returned: 0 in 0.720s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:51 devstack sudo[83749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e
Apr 09 10:39:51 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:52 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e" returned: 0 in 0.581s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8063be-5c51-41b3-b3d5-a96a25d9adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4359723-3f1f-41b9-b25f-e8a4fc1b1f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:52 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Volume volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e (9ee0eefb-b811-45de-a6d0-d2c2a1e9732e): created successfully
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4359723-3f1f-41b9-b25f-e8a4fc1b1f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Flow 'volume_create_manager' (8227b515-c2a3-46f8-bdb5-8159741da0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:52 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-75f82468-bad1-4906-96e0-10ea83a5207d tempest-VolumesTestJSON-948372996 None] Created volume successfully.
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Flow 'volume_create_manager' (754f6752-1e62-4b53-bf40-22419bed1026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17530ab8-d33a-4a97-8eb9-d8cabd646f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17530ab8-d33a-4a97-8eb9-d8cabd646f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1413736293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec88246f-2c96-468f-9043-c8eeb0948d13,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='755d80fbff32468ea05fa8e9b1f756ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:54Z,use_quota=True,user_id='6e63bbe992874f7d90b5e18e9e5b2cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf8f70a-c6a4-478c-b31b-756f1ad705e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf8f70a-c6a4-478c-b31b-756f1ad705e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9109422-a42e-451a-98a4-2b9b8241ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9109422-a42e-451a-98a4-2b9b8241ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec88246f-2c96-468f-9043-c8eeb0948d13', 'volume_name': 'volume-ec88246f-2c96-468f-9043-c8eeb0948d13', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b9fb28-ebaa-4ad5-adb0-0c28ae6adab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b9fb28-ebaa-4ad5-adb0-0c28ae6adab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3943a952-72e8-4fc9-b8f9-7195c9a42745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:54 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Volume ec88246f-2c96-468f-9043-c8eeb0948d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec88246f-2c96-468f-9043-c8eeb0948d13', 'volume_size': 1}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1413736293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec88246f-2c96-468f-9043-c8eeb0948d13,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='755d80fbff32468ea05fa8e9b1f756ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:39:54Z,use_quota=True,user_id='6e63bbe992874f7d90b5e18e9e5b2cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Creating volume ec88246f-2c96-468f-9043-c8eeb0948d13 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:39:54 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:54 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13 1073741824
Apr 09 10:39:54 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:54 devstack cinder-volume[82783]: WARNING py.warnings [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 09 10:39:54 devstack cinder-volume[82783]:   .first()
Apr 09 10:39:54 devstack cinder-volume[82783]: 
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:39:55 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13 1073741824" returned: 0 in 0.914s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:55 devstack sudo[83786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13
Apr 09 10:39:55 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:55 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13" returned: 0 in 0.499s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.681s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:55 devstack cinder-volume[82783]: INFO oslo.privsep.daemon [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp763zs87d/privsep.sock']
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3943a952-72e8-4fc9-b8f9-7195c9a42745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec88246f-2c96-468f-9043-c8eeb0948d13', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76983eb-7873-4494-a34b-0a40ae1542b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:39:55 devstack sudo[83789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp763zs87d/privsep.sock
Apr 09 10:39:55 devstack sudo[83789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:55 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Volume volume-ec88246f-2c96-468f-9043-c8eeb0948d13 (ec88246f-2c96-468f-9043-c8eeb0948d13): created successfully
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76983eb-7873-4494-a34b-0a40ae1542b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:39:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Flow 'volume_create_manager' (754f6752-1e62-4b53-bf40-22419bed1026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:39:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-d2fb27a3-0150-406a-b293-fa812416de81 tempest-VolumesTestJSON-948372996 None] Created volume successfully.
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 10:39:56 devstack cinder-volume[82783]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 09 10:39:57 devstack sudo[83789]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:57 devstack cinder-volume[82783]: INFO oslo.privsep.daemon [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Spawned new privsep daemon via rootwrap
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Accepted privsep connection to /tmp/tmp763zs87d/privsep.sock {{(pid=82783) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 09 10:39:57 devstack cinder-volume[82783]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 09 10:39:57 devstack cinder-volume[82783]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 09 10:39:57 devstack cinder-volume[82783]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 09 10:39:57 devstack cinder-volume[82783]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83793
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8073ade2-b264-484a-be61-e6a985bbe036]: (2,) {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a748b253-5f32-4444-b5b7-f8b06fad08c7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:57 devstack sudo[83795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1
Apr 09 10:39:57 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:57 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1" returned: 0 in 0.547s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.989s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.646s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933c9d6-d117-4879-b402-e67047a6381b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427', 'name': 'volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '167344e6-95dc-4017-a95a-c5ce27979628', 'enforce_multipath': True} {{(pid=82783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 10:39:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-b2dc8d4f-d04a-4d43-a24a-dcfcb4f57d34 req-0e61a28e-f611-4e51-9e59-48ba50cb2e1d tempest-DeleteServersTestJSON-863074277 None] attachment_update completed successfully.
Apr 09 10:39:57 devstack sudo[83800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca
Apr 09 10:39:57 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:58 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca" returned: 0 in 0.798s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.841s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:39:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427', 'name': 'volume-9ae2796b-8436-480b-9020-d384e86b87ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '727d507e-c03e-40be-84ae-19c54db4feb3', 'enforce_multipath': True} {{(pid=82783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 10:39:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-6676cd7f-58d5-4817-8a3a-6e3a5e66f3aa req-479a4e2d-6394-4d34-9b71-b9a05f386c34 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] attachment_update completed successfully.
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Acquiring lock "cinder-ec88246f-2c96-468f-9043-c8eeb0948d13-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Lock "cinder-ec88246f-2c96-468f-9043-c8eeb0948d13-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Acquiring lock "cinder-quobyte-ec88246f-2c96-468f-9043-c8eeb0948d13" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Lock "cinder-quobyte-ec88246f-2c96-468f-9043-c8eeb0948d13" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[de89f12f-bda5-4789-895e-05349a4f55c0]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:59 devstack sudo[84192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13
Apr 09 10:39:59 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:39:59 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13" returned: 0 in 0.713s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:39:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:39:59 devstack sudo[84200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13
Apr 09 10:39:59 devstack sudo[84200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:00 devstack sudo[84200]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ec88246f-2c96-468f-9043-c8eeb0948d13" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Lock "cinder-quobyte-ec88246f-2c96-468f-9043-c8eeb0948d13" released by "delete_volume" :: held 1.265s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:00 devstack cinder-volume[82783]: WARNING cinder.quota [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:00 devstack cinder-volume[82783]: WARNING cinder.quota [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Created reservations ['1584c11f-7161-4cff-9b48-2d4f31490042', '4f2e938c-7f45-42d4-bc91-2c47c821faaf', 'fc6c0599-588f-4d3c-84c1-18ecb21f6779', '35fe842f-0ba3-4ebf-85dc-ba1d2b12f5dd'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:00 devstack sudo[84203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:00 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:01 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.455s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:01 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Deleted volume successfully.
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cda37896-fbca-4c78-a4ea-7f25fa5bb758 tempest-VolumesTestJSON-948372996 None] Lock "cinder-ec88246f-2c96-468f-9043-c8eeb0948d13-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Acquiring lock "cinder-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Lock "cinder-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Acquiring lock "cinder-quobyte-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Lock "cinder-quobyte-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c63b12-d932-4180-9b4e-068dd9b4ea8e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:01 devstack sudo[84206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e
Apr 09 10:40:01 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:01 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:01 devstack sudo[84214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e
Apr 09 10:40:01 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:02 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e" returned: 0 in 0.532s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Lock "cinder-quobyte-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e" released by "delete_volume" :: held 1.085s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Created reservations ['0717613a-cc6c-428e-b12f-b254540d733a', '187e61ab-c9ff-4103-b20c-a33ba00c6532', '91500b6d-015a-4de3-90ad-d43b5c7f6aac', '11df4632-2794-43b7-a9f9-d5d9af11d6e7'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:02 devstack sudo[84219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:02 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:02 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.481s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Deleted volume successfully.
Apr 09 10:40:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-07150690-9b02-4693-a17c-23203db1fc17 tempest-VolumesTestJSON-948372996 None] Lock "cinder-9ee0eefb-b811-45de-a6d0-d2c2a1e9732e-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Acquiring lock "cinder-8a333c09-dc90-4054-9277-a1edf782e707-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Lock "cinder-8a333c09-dc90-4054-9277-a1edf782e707-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Acquiring lock "cinder-quobyte-8a333c09-dc90-4054-9277-a1edf782e707" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Lock "cinder-quobyte-8a333c09-dc90-4054-9277-a1edf782e707" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:03 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[42421546-9659-4046-ae77-ad1db3565c24]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:03 devstack sudo[84255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707
Apr 09 10:40:03 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:04 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707" returned: 0 in 0.762s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:04 devstack sudo[84287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707
Apr 09 10:40:04 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:04 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a333c09-dc90-4054-9277-a1edf782e707" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Lock "cinder-quobyte-8a333c09-dc90-4054-9277-a1edf782e707" released by "delete_volume" :: held 1.331s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:04 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Created reservations ['fc6f14f8-8d04-4b58-9325-5f0cc2f4bf66', '86ed81b6-9968-4a0a-91c1-82da3cf58e58', '3708ca4a-1108-420d-9342-8040fbd7c72e', '982dc3d7-f9b6-43e8-b290-b26f48971cf5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:05 devstack sudo[84292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:05 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:05 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.522s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:05 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Deleted volume successfully.
Apr 09 10:40:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a811f0c0-b9bc-4c12-af89-3098d02c59e6 tempest-VolumesTestJSON-948372996 None] Lock "cinder-8a333c09-dc90-4054-9277-a1edf782e707-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:06 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-613b2570-7aca-4a0e-b9a9-722e429845ac req-3b477139-1ecf-41ae-a406-2ec8cc772c3c tempest-DeleteServersTestJSON-863074277 None] Terminate volume connection completed successfully.
Apr 09 10:40:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-613b2570-7aca-4a0e-b9a9-722e429845ac req-3b477139-1ecf-41ae-a406-2ec8cc772c3c tempest-DeleteServersTestJSON-863074277 None] Deleting attachment 167344e6-95dc-4017-a95a-c5ce27979628. {{(pid=82783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 10:40:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2081af7c-9c9a-4796-86dd-f009222122c4 tempest-GroupSnapshotsV319Test-908730488 None] Group tempest-GroupSnapshotsV319Test-Group-245401577: creating
Apr 09 10:40:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2081af7c-9c9a-4796-86dd-f009222122c4 tempest-GroupSnapshotsV319Test-908730488 None] Group tempest-GroupSnapshotsV319Test-Group-245401577: created successfully
Apr 09 10:40:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2081af7c-9c9a-4796-86dd-f009222122c4 tempest-GroupSnapshotsV319Test-908730488 None] Create group completed successfully.
Apr 09 10:40:09 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Flow 'volume_create_manager' (d3c446d9-80d9-46bf-89fa-e715f3e6a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db28037-428c-498d-a1a8-1de30721dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db28037-428c-498d-a1a8-1de30721dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2021058357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46475449-8ab7-46bb-beea-fba1bee17fe3,host='devstack@QuobyteHD#QuobyteHD',id=8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08bdec3e68b4ea6b7b60c09a7a5feb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:10Z,use_quota=True,user_id='7f3f7f2342004477bf76198fe070f07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485fa359-9d9c-4e4c-8881-1348351335aa),volume_type_id=485fa359-9d9c-4e4c-8881-1348351335aa)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20ee89a-3eac-4ba7-8f71-b3fc2fd68076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20ee89a-3eac-4ba7-8f71-b3fc2fd68076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3db156f-062c-49f3-adcf-d0108b009e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3db156f-062c-49f3-adcf-d0108b009e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6', 'volume_name': 'volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7c65f5-8fcb-47d5-a816-d5a3289867df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7c65f5-8fcb-47d5-a816-d5a3289867df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de1063e-7883-4d37-bcfb-96b44d21fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:10 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Volume 8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6', 'volume_size': 1}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=46475449-8ab7-46bb-beea-fba1bee17fe3,created_at=2026-04-09T08:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2021058357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46475449-8ab7-46bb-beea-fba1bee17fe3,host='devstack@QuobyteHD#QuobyteHD',id=8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08bdec3e68b4ea6b7b60c09a7a5feb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:10Z,use_quota=True,user_id='7f3f7f2342004477bf76198fe070f07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485fa359-9d9c-4e4c-8881-1348351335aa),volume_type_id=485fa359-9d9c-4e4c-8881-1348351335aa)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Creating volume 8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:10 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:10 devstack sudo[84319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 1073741824
Apr 09 10:40:10 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Acquiring lock "cinder-662ce0b0-725b-4d2b-9484-04964ad1cfc1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Lock "cinder-662ce0b0-725b-4d2b-9484-04964ad1cfc1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Acquiring lock "cinder-quobyte-662ce0b0-725b-4d2b-9484-04964ad1cfc1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Lock "cinder-quobyte-662ce0b0-725b-4d2b-9484-04964ad1cfc1" acquired by "delete_volume" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ec4a2-ffc8-4bd7-ad01-b47572645d98]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:10 devstack sudo[84321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1
Apr 09 10:40:10 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:10 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 1073741824" returned: 0 in 0.776s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:10 devstack sudo[84381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6
Apr 09 10:40:10 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:11 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1" returned: 0 in 0.996s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:11 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:11 devstack sudo[84390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1
Apr 09 10:40:11 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de1063e-7883-4d37-bcfb-96b44d21fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9619cc52-c29c-4a51-b3fe-a161287b1d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Volume volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 (8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6): created successfully
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9619cc52-c29c-4a51-b3fe-a161287b1d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Flow 'volume_create_manager' (d3c446d9-80d9-46bf-89fa-e715f3e6a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7e422c81-3126-4577-9942-8aca3c6e2fce tempest-GroupSnapshotsV319Test-908730488 None] Created volume successfully.
Apr 09 10:40:11 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-662ce0b0-725b-4d2b-9484-04964ad1cfc1" returned: 0 in 0.425s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Lock "cinder-quobyte-662ce0b0-725b-4d2b-9484-04964ad1cfc1" released by "delete_volume" :: held 1.455s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Created reservations ['e8c72ad7-faff-49ef-a781-51766b8bd801', '0590a809-a4ad-4cde-b6b9-1a197c618959', '983f5b91-bc47-4328-94b1-4e01bfc7b054', 'f0816280-8c86-40f2-8244-d7d89f7b47f3'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:11 devstack sudo[84395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:11 devstack sudo[84395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:12 devstack sudo[84395]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Deleted volume successfully.
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1fd00067-583e-4901-a758-311bb61b489a tempest-DeleteServersTestJSON-863074277 None] Lock "cinder-662ce0b0-725b-4d2b-9484-04964ad1cfc1-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] GroupSnapshot d5e6f848-02d3-4c73-9a96-121cab8da44d: creating.
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Group snapshot d5e6f848-02d3-4c73-9a96-121cab8da44d: creating. {{(pid=82783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Creating offline snapshot 131ac4ae-4589-4ff9-b683-b72a5d1bed7b of volume 8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f2ed1-ea82-4a59-b99c-630d25da9cc0]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:12 devstack sudo[84418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6
Apr 09 10:40:12 devstack sudo[84418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:12 devstack sudo[84418]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:12 devstack sudo[84425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b 1G
Apr 09 10:40:12 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:13 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b 1G" returned: 0 in 0.652s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:13 devstack sudo[84432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b
Apr 09 10:40:13 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:14 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:14 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:40:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:14 devstack sudo[84438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b
Apr 09 10:40:14 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:14 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b" returned: 0 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:14 devstack sudo[84441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info
Apr 09 10:40:14 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Flow 'volume_create_manager' (3e72f618-cae0-42cf-8123-edc9cbb866a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539ef205-ee69-4eeb-a9b2-c2d9c60a3875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539ef205-ee69-4eeb-a9b2-c2d9c60a3875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-533556268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69b0dbc-4185-48fc-aa17-d38470796ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd312b20fbe24619804f86ea2c447248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:15Z,use_quota=True,user_id='0dd02b2caa0c4e4bb342390ef77ecfc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e5a720-fc8a-42c1-9c1c-651c63dd3ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e5a720-fc8a-42c1-9c1c-651c63dd3ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c397b22-a661-4aa9-82b6-85630995617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c397b22-a661-4aa9-82b6-85630995617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69b0dbc-4185-48fc-aa17-d38470796ebc', 'volume_name': 'volume-b69b0dbc-4185-48fc-aa17-d38470796ebc', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfdf1cd-1fe8-4e88-8be2-315c213024a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfdf1cd-1fe8-4e88-8be2-315c213024a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe41a74a-7da2-4e78-b922-1a7e2fc26e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:15 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Volume b69b0dbc-4185-48fc-aa17-d38470796ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69b0dbc-4185-48fc-aa17-d38470796ebc', 'volume_size': 1}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:15 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info" returned: 0 in 0.503s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:15 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:15 devstack sudo[84445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info
Apr 09 10:40:15 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:15 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.info" returned: 0 in 0.506s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.277s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-533556268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69b0dbc-4185-48fc-aa17-d38470796ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd312b20fbe24619804f86ea2c447248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:15Z,use_quota=True,user_id='0dd02b2caa0c4e4bb342390ef77ecfc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Creating volume b69b0dbc-4185-48fc-aa17-d38470796ebc {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:15 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:15 devstack sudo[84449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc 1073741824
Apr 09 10:40:15 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:15 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-26186a40-af37-4c4b-921e-120664f357aa tempest-GroupSnapshotsV319Test-908730488 None] group_snapshot d5e6f848-02d3-4c73-9a96-121cab8da44d: created successfully
Apr 09 10:40:16 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc 1073741824" returned: 0 in 0.581s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:16 devstack sudo[84454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc
Apr 09 10:40:16 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:17 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc" returned: 0 in 0.637s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe41a74a-7da2-4e78-b922-1a7e2fc26e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69b0dbc-4185-48fc-aa17-d38470796ebc', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bcdadd-6b3e-4e37-9c03-18d3b8f95d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:17 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Volume volume-b69b0dbc-4185-48fc-aa17-d38470796ebc (b69b0dbc-4185-48fc-aa17-d38470796ebc): created successfully
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bcdadd-6b3e-4e37-9c03-18d3b8f95d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Flow 'volume_create_manager' (3e72f618-cae0-42cf-8123-edc9cbb866a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-85ff0bc9-1266-4bb6-945d-666cdde80ee7 tempest-VolumesAdminNegativeTest-1727584035 None] Created volume successfully.
Apr 09 10:40:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] group_snapshot d5e6f848-02d3-4c73-9a96-121cab8da44d: deleting
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] group_snapshot d5e6f848-02d3-4c73-9a96-121cab8da44d: deleting {{(pid=82783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "cinder-quobyte-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Lock "cinder-quobyte-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "cinder-quobyte-131ac4ae-4589-4ff9-b683-b72a5d1bed7b" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Lock "cinder-quobyte-131ac4ae-4589-4ff9-b683-b72a5d1bed7b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Deleting offline snapshot 131ac4ae-4589-4ff9-b683-b72a5d1bed7b of volume 8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] snapshot_file for this snap is: volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e04747-58ce-4152-9370-0e8ad2f49084]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:17 devstack sudo[84485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b
Apr 09 10:40:17 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:18 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b" returned: 0 in 1.013s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba84328-b666-4790-9000-b4740d10de8d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:18 devstack sudo[84515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6
Apr 09 10:40:18 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Acquiring lock "cinder-b69b0dbc-4185-48fc-aa17-d38470796ebc-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "cinder-b69b0dbc-4185-48fc-aa17-d38470796ebc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Acquiring lock "cinder-quobyte-b69b0dbc-4185-48fc-aa17-d38470796ebc" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "cinder-quobyte-b69b0dbc-4185-48fc-aa17-d38470796ebc" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:19 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[989a57ed-3f1d-4856-bafb-a80a1d778d13]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:19 devstack sudo[84518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc
Apr 09 10:40:19 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:19 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" returned: 0 in 1.054s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:19 devstack sudo[84525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b
Apr 09 10:40:19 devstack sudo[84525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:20 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc" returned: 0 in 1.254s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:20 devstack sudo[84533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc
Apr 09 10:40:20 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:20 devstack sudo[84525]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b" returned: 0 in 0.859s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:20 devstack sudo[84535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b
Apr 09 10:40:20 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:21 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b69b0dbc-4185-48fc-aa17-d38470796ebc" returned: 0 in 0.780s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "cinder-quobyte-b69b0dbc-4185-48fc-aa17-d38470796ebc" released by "delete_volume" :: held 2.094s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:21 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6.131ac4ae-4589-4ff9-b683-b72a5d1bed7b" returned: 0 in 0.752s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Lock "cinder-quobyte-131ac4ae-4589-4ff9-b683-b72a5d1bed7b" released by "_delete_snapshot" :: held 3.847s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Lock "cinder-quobyte-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" released by "delete_snapshot" :: held 3.886s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:21 devstack cinder-volume[82783]: WARNING cinder.quota [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1722619060 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1722619060, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:21 devstack cinder-volume[82783]: WARNING cinder.quota [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1722619060 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1722619060, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Created reservations ['9e5a2b84-1552-448f-906d-a3454a451bd4', 'ffa0b6d6-8da2-4f4b-a730-fca1d72a6b6a', '780a9af7-8133-4f4c-a3f4-11dde21cc006', '6ea5c18e-65ad-41a3-8466-e9d57e6854eb'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] Created reservations ['50be960f-e26d-496a-9c4f-2e0d98d108da', '8cfcc224-c2a8-44cd-917f-e78e4579a6f2', '526f9839-a2ae-4c1c-b809-db62c3da6623', '80009216-0d09-470e-86e5-705b7385ce4b'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:21 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c23a2376-fbfc-4cb8-873f-cf26b51deb0a tempest-GroupSnapshotsV319Test-908730488 None] group_snapshot d5e6f848-02d3-4c73-9a96-121cab8da44d: deleted successfully
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:21 devstack sudo[84539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:21 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:21 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.528s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:21 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Deleted volume successfully.
Apr 09 10:40:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-498870d4-661e-41ae-b48d-b831accd85a4 tempest-VolumesAdminNegativeTest-1727584035 None] Lock "cinder-b69b0dbc-4185-48fc-aa17-d38470796ebc-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "cinder-quobyte-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Lock "cinder-quobyte-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:22 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a485b73b-dd5a-4d15-b742-39f38b0ee961]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:22 devstack sudo[84543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6
Apr 09 10:40:22 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:23 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" returned: 0 in 0.825s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:23 devstack sudo[84574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6
Apr 09 10:40:23 devstack sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:23 devstack sudo[84574]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" returned: 0 in 0.624s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Lock "cinder-quobyte-8a22dc8b-4f8e-4dbe-a0f4-92d5f8b0c2f6" released by "delete_volume" :: held 1.510s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:23 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Created reservations ['30e5fefc-ed12-409c-bdc1-e2075740049e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:23 devstack cinder-volume[82783]: WARNING cinder.quota [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1722619060 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1722619060, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:23 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Created reservations ['a88d4b32-31cb-4a5f-b618-d25962d1aded', 'f2a7b204-1474-48b6-9181-fd64b6adca21', '13b4f8be-03ce-4502-b748-284d483cd5ad', 'a8695482-b58f-4146-957f-a802d51c5f9e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:24 devstack sudo[84619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:24 devstack sudo[84619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-67786dee-95f8-47fd-89f0-590bbddeb7bb tempest-GroupsTest-767719542 None] Group tempest-Group1-433189876: creating
Apr 09 10:40:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-67786dee-95f8-47fd-89f0-590bbddeb7bb tempest-GroupsTest-767719542 None] Group tempest-Group1-433189876: created successfully
Apr 09 10:40:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-67786dee-95f8-47fd-89f0-590bbddeb7bb tempest-GroupsTest-767719542 None] Create group completed successfully.
Apr 09 10:40:24 devstack sudo[84619]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.609s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:24 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-61b52b95-84ab-4481-a039-b156a72259e4 tempest-GroupSnapshotsV319Test-908730488 None] Delete group completed successfully.
Apr 09 10:40:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-aed6e5b6-7e43-4d9c-a301-039ee5bb03ac tempest-GroupsTest-767719542 None] Group tempest-Group2-872508624: creating
Apr 09 10:40:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-aed6e5b6-7e43-4d9c-a301-039ee5bb03ac tempest-GroupsTest-767719542 None] Group tempest-Group2-872508624: created successfully
Apr 09 10:40:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-aed6e5b6-7e43-4d9c-a301-039ee5bb03ac tempest-GroupsTest-767719542 None] Create group completed successfully.
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Flow 'volume_create_manager' (1135bcbe-a3ca-412e-bcff-aa4aa44c6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06a2f48-b99c-41c2-80cc-0aa249634418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06a2f48-b99c-41c2-80cc-0aa249634418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1107404406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bc9ab770-3b26-4239-87eb-28029570076e,host='devstack@QuobyteHD#QuobyteHD',id=ee980874-fe56-4e99-be9e-8f8c64932b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a0ad31f1824aee9942a5f541820be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:27Z,use_quota=True,user_id='c0fc957f9684456691647e8577787e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b06cbd28-cc23-4e95-aae9-053e17bbe3a7),volume_type_id=b06cbd28-cc23-4e95-aae9-053e17bbe3a7)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe907c71-0d8e-419b-b4e7-b567feeed0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe907c71-0d8e-419b-b4e7-b567feeed0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178188d8-b9d0-4c4d-a773-1a901c4e3719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178188d8-b9d0-4c4d-a773-1a901c4e3719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee980874-fe56-4e99-be9e-8f8c64932b61', 'volume_name': 'volume-ee980874-fe56-4e99-be9e-8f8c64932b61', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b28679-b069-46dc-b54f-9b44b7cb09ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b28679-b069-46dc-b54f-9b44b7cb09ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b9f0e9-55fd-4af9-8d6f-9d4b90b5acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:26 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Volume ee980874-fe56-4e99-be9e-8f8c64932b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee980874-fe56-4e99-be9e-8f8c64932b61', 'volume_size': 1}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bc9ab770-3b26-4239-87eb-28029570076e,created_at=2026-04-09T08:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1107404406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bc9ab770-3b26-4239-87eb-28029570076e,host='devstack@QuobyteHD#QuobyteHD',id=ee980874-fe56-4e99-be9e-8f8c64932b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a0ad31f1824aee9942a5f541820be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:27Z,use_quota=True,user_id='c0fc957f9684456691647e8577787e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b06cbd28-cc23-4e95-aae9-053e17bbe3a7),volume_type_id=b06cbd28-cc23-4e95-aae9-053e17bbe3a7)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Creating volume ee980874-fe56-4e99-be9e-8f8c64932b61 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:26 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:26 devstack sudo[84635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61 1073741824
Apr 09 10:40:26 devstack sudo[84635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:27 devstack sudo[84635]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61 1073741824" returned: 0 in 0.574s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:27 devstack sudo[84642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61
Apr 09 10:40:27 devstack sudo[84642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:28 devstack sudo[84642]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61" returned: 0 in 0.535s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b9f0e9-55fd-4af9-8d6f-9d4b90b5acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee980874-fe56-4e99-be9e-8f8c64932b61', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dfedff-2774-4bd8-9527-56f0abcbdae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:28 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Volume volume-ee980874-fe56-4e99-be9e-8f8c64932b61 (ee980874-fe56-4e99-be9e-8f8c64932b61): created successfully
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dfedff-2774-4bd8-9527-56f0abcbdae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Flow 'volume_create_manager' (1135bcbe-a3ca-412e-bcff-aa4aa44c6484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:28 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e37297aa-e175-4b9a-98d9-23aa301ba5c7 tempest-GroupsTest-767719542 None] Created volume successfully.
Apr 09 10:40:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Acquiring lock "cinder-quobyte-ee980874-fe56-4e99-be9e-8f8c64932b61" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Lock "cinder-quobyte-ee980874-fe56-4e99-be9e-8f8c64932b61" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:29 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdc738b-873d-4b81-8d28-339bd2e02378]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:29 devstack sudo[84645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61
Apr 09 10:40:29 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:30 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61" returned: 0 in 0.675s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:30 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61
Apr 09 10:40:30 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:30 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee980874-fe56-4e99-be9e-8f8c64932b61" returned: 0 in 0.542s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Lock "cinder-quobyte-ee980874-fe56-4e99-be9e-8f8c64932b61" released by "delete_volume" :: held 1.266s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Created reservations ['a57d5b72-d3be-471c-b0c4-348447aeced5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:30 devstack cinder-volume[82783]: WARNING cinder.quota [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1560538768 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1560538768, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:30 devstack cinder-volume[82783]: WARNING cinder.quota [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1560538768 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1560538768, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Created reservations ['1749ca6e-32bf-44a6-aed9-930a93b759b8', '3f9674e5-a56f-42e6-84b8-d97543179b2e', '1be664d6-faf5-447e-b756-bcb513d5d2a1', '2e00e23f-baff-4a5e-a4d9-36e2f1792742'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:30 devstack sudo[84655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:30 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:31 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.631s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a43b51e8-e3c5-4c01-89fe-9b6b29a7cd05 tempest-GroupsTest-767719542 None] Delete group completed successfully.
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Created reservations ['12b10c00-d680-496a-b608-ecb7543eef14'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:31 devstack sudo[84658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:31 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:32 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.543s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1c876166-baa3-4410-86fb-eb371e9fa0cf tempest-GroupsTest-767719542 None] Delete group completed successfully.
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Flow 'volume_create_manager' (5ad834d0-151e-4432-8228-e376b0fc056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41b6965-e7e1-4410-b5f6-3255f31d5226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41b6965-e7e1-4410-b5f6-3255f31d5226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-216999748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d109a4a7-061a-4c7c-beeb-fa10c60a563f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2738fe82e9b047b0a2d1ba3754951355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:33Z,use_quota=True,user_id='c302ac02799443359f87f93dea22a4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a5512b-e8e1-4ddc-9845-351a716d1800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a5512b-e8e1-4ddc-9845-351a716d1800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187efe04-a00f-4cdb-a7f9-7850f29d5239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187efe04-a00f-4cdb-a7f9-7850f29d5239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd109a4a7-061a-4c7c-beeb-fa10c60a563f', 'volume_name': 'volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9710f448-c7b3-4d93-b061-68ce83f7c861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9710f448-c7b3-4d93-b061-68ce83f7c861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5da3ea4-52bf-43a4-852d-c6f22c3c6e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Volume d109a4a7-061a-4c7c-beeb-fa10c60a563f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f', 'volume_size': 1}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-216999748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d109a4a7-061a-4c7c-beeb-fa10c60a563f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2738fe82e9b047b0a2d1ba3754951355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:33Z,use_quota=True,user_id='c302ac02799443359f87f93dea22a4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Creating volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:32 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:32 devstack sudo[84669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f 1073741824
Apr 09 10:40:32 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-924ac3ba-ca9f-44ba-a3a0-0e3d74379812 tempest-GroupsTest-767719542 None] Group tempest-GroupsTest-Group-1881765682: creating
Apr 09 10:40:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-924ac3ba-ca9f-44ba-a3a0-0e3d74379812 tempest-GroupsTest-767719542 None] Group tempest-GroupsTest-Group-1881765682: created successfully
Apr 09 10:40:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-924ac3ba-ca9f-44ba-a3a0-0e3d74379812 tempest-GroupsTest-767719542 None] Create group completed successfully.
Apr 09 10:40:33 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f 1073741824" returned: 0 in 0.713s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:33 devstack sudo[84686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f
Apr 09 10:40:33 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:33 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f" returned: 0 in 0.434s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5da3ea4-52bf-43a4-852d-c6f22c3c6e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2858f9-fff2-45f9-9666-f3818c9992cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Volume volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f (d109a4a7-061a-4c7c-beeb-fa10c60a563f): created successfully
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2858f9-fff2-45f9-9666-f3818c9992cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Flow 'volume_create_manager' (5ad834d0-151e-4432-8228-e376b0fc056f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-137867f7-b2c8-4a40-9b59-9d553253ed72 tempest-SnapshotsActionsTest-230883483 None] Created volume successfully.
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Flow 'volume_create_manager' (c9e4fdbb-2b24-4c4d-854c-febc140a4909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e064fa9f-30a9-4716-b6d1-71c3b446dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e064fa9f-30a9-4716-b6d1-71c3b446dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1227984007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d56074c5-489b-4dc4-9f70-f725d09420ea,host='devstack@QuobyteHD#QuobyteHD',id=54077501-8967-4aad-944d-ec66c576495f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a0ad31f1824aee9942a5f541820be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:35Z,use_quota=True,user_id='c0fc957f9684456691647e8577787e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0d9806d-bdc4-4950-ac0e-450d588df473),volume_type_id=b0d9806d-bdc4-4950-ac0e-450d588df473)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af668dbe-9b06-4fee-82ec-34790e17a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af668dbe-9b06-4fee-82ec-34790e17a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6b39b0-c887-4311-8b5e-0034d8d597e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6b39b0-c887-4311-8b5e-0034d8d597e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54077501-8967-4aad-944d-ec66c576495f', 'volume_name': 'volume-54077501-8967-4aad-944d-ec66c576495f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ddf8ff-7b8e-4088-8943-8a059595b9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ddf8ff-7b8e-4088-8943-8a059595b9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c16369e-902a-4e75-b81c-e4fd0aa2b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Volume 54077501-8967-4aad-944d-ec66c576495f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54077501-8967-4aad-944d-ec66c576495f', 'volume_size': 1}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d56074c5-489b-4dc4-9f70-f725d09420ea,created_at=2026-04-09T08:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1227984007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d56074c5-489b-4dc4-9f70-f725d09420ea,host='devstack@QuobyteHD#QuobyteHD',id=54077501-8967-4aad-944d-ec66c576495f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a0ad31f1824aee9942a5f541820be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:35Z,use_quota=True,user_id='c0fc957f9684456691647e8577787e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0d9806d-bdc4-4950-ac0e-450d588df473),volume_type_id=b0d9806d-bdc4-4950-ac0e-450d588df473)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Creating volume 54077501-8967-4aad-944d-ec66c576495f {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:34 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:34 devstack sudo[84689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f 1073741824
Apr 09 10:40:34 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:35 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f 1073741824" returned: 0 in 0.556s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:35 devstack sudo[84695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f
Apr 09 10:40:35 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:35 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f" returned: 0 in 0.416s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.877s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=108,cinder:UPDATE=112,cinder:INSERT=22,cinder:DELETE=7 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c16369e-902a-4e75-b81c-e4fd0aa2b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54077501-8967-4aad-944d-ec66c576495f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ff2fb8-fca8-4b0d-b93f-567c28174b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Creating offline snapshot 520023b9-7510-40c1-a6bb-02c9129d7112 of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:40:35 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Volume volume-54077501-8967-4aad-944d-ec66c576495f (54077501-8967-4aad-944d-ec66c576495f): created successfully
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ff2fb8-fca8-4b0d-b93f-567c28174b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Flow 'volume_create_manager' (c9e4fdbb-2b24-4c4d-854c-febc140a4909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c68a469-ec7e-4647-846c-2cdd0bfcc6e9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a35b7daf-d0a1-4e8d-8f54-c016936897e4 tempest-GroupsTest-767719542 None] Created volume successfully.
Apr 09 10:40:35 devstack sudo[84701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f
Apr 09 10:40:35 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:36 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:36 devstack sudo[84707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 1G
Apr 09 10:40:36 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:36 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 1G" returned: 0 in 0.507s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:36 devstack sudo[84712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:36 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=93,cinder:UPDATE=108,cinder:DELETE=7,cinder:INSERT=24 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Flow 'volume_create_manager' (5d21e96e-50f7-4b7c-a878-9330ab16c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f0c27c-967d-41fd-9a46-19ba55a3a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f0c27c-967d-41fd-9a46-19ba55a3a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033118759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d56074c5-489b-4dc4-9f70-f725d09420ea,host='devstack@QuobyteHD#QuobyteHD',id=e0393e53-59af-455c-ba93-4f5c4ffe2357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a0ad31f1824aee9942a5f541820be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:37Z,use_quota=True,user_id='c0fc957f9684456691647e8577787e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0d9806d-bdc4-4950-ac0e-450d588df473),volume_type_id=b0d9806d-bdc4-4950-ac0e-450d588df473)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8cf9bc-b581-4008-8821-e0b8dec10e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8cf9bc-b581-4008-8821-e0b8dec10e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523bc812-0d58-4271-a998-5ec1ebafde14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523bc812-0d58-4271-a998-5ec1ebafde14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0393e53-59af-455c-ba93-4f5c4ffe2357', 'volume_name': 'volume-e0393e53-59af-455c-ba93-4f5c4ffe2357', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db772d25-2fe5-4bee-bf32-b27f73c4f5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db772d25-2fe5-4bee-bf32-b27f73c4f5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b345cf-7570-452d-a229-ce972ddde590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Volume e0393e53-59af-455c-ba93-4f5c4ffe2357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0393e53-59af-455c-ba93-4f5c4ffe2357', 'volume_size': 1}
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:37 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:37 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 is being set with open permissions: ugo+rw
Apr 09 10:40:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:37 devstack sudo[84717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:37 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:38 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.673s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:38 devstack sudo[84748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info
Apr 09 10:40:38 devstack sudo[84748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:38 devstack sudo[84748]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:38 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info is being set with open permissions: ugo+rw
Apr 09 10:40:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:38 devstack sudo[84752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info
Apr 09 10:40:38 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:39 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.info" returned: 0 in 0.537s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.273s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d56074c5-489b-4dc4-9f70-f725d09420ea,created_at=2026-04-09T08:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033118759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d56074c5-489b-4dc4-9f70-f725d09420ea,host='devstack@QuobyteHD#QuobyteHD',id=e0393e53-59af-455c-ba93-4f5c4ffe2357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a0ad31f1824aee9942a5f541820be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:37Z,use_quota=True,user_id='c0fc957f9684456691647e8577787e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0d9806d-bdc4-4950-ac0e-450d588df473),volume_type_id=b0d9806d-bdc4-4950-ac0e-450d588df473)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Creating volume e0393e53-59af-455c-ba93-4f5c4ffe2357 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:39 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:39 devstack sudo[84757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 1073741824
Apr 09 10:40:39 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:39 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-d872825b-2cc7-4048-8a4a-49b1e9f31605 tempest-SnapshotsActionsTest-230883483 None] Create snapshot completed successfully
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:39 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:39 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:39 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 1073741824" returned: 0 in 0.670s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:39 devstack sudo[84764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357
Apr 09 10:40:39 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:40 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.631s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:40 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b345cf-7570-452d-a229-ce972ddde590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0393e53-59af-455c-ba93-4f5c4ffe2357', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc88f8bb-0ba2-45e6-8fff-d9ece89f5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:40 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Volume volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 (e0393e53-59af-455c-ba93-4f5c4ffe2357): created successfully
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc88f8bb-0ba2-45e6-8fff-d9ece89f5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Flow 'volume_create_manager' (5d21e96e-50f7-4b7c-a878-9330ab16c746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2b273bdf-8ee7-451a-b13a-ef4eac08e0ef tempest-GroupsTest-767719542 None] Created volume successfully.
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Creating offline snapshot 7e636f53-1170-43fb-88fe-e35a659d6c82 of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:40:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fa41eab8-06d2-4b5c-8b33-9cabf4d6e1ee tempest-GroupsTest-767719542 None] Update group completed successfully.
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d91a3d-6ad4-4be0-ad70-6749819e33c6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:40 devstack sudo[84769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:40 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:41 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.555s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:41 devstack sudo[84774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 1G
Apr 09 10:40:41 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-415993f1-62ba-4e96-bf9c-dcd572d2006a tempest-GroupsTest-767719542 None] Update group completed successfully.
Apr 09 10:40:42 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 1G" returned: 0 in 0.680s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:42 devstack sudo[84780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82
Apr 09 10:40:42 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:42 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82" returned: 0 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:42 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 is being set with open permissions: ugo+rw
Apr 09 10:40:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:42 devstack sudo[84787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82
Apr 09 10:40:42 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:43 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:43 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-23c09789-a296-4ba0-bc6a-d741edcd2683 tempest-SnapshotsActionsTest-230883483 None] Create snapshot completed successfully
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Acquiring lock "cinder-quobyte-54077501-8967-4aad-944d-ec66c576495f" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Lock "cinder-quobyte-54077501-8967-4aad-944d-ec66c576495f" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb368e-f95c-4d39-9446-b64ecbe2df59]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:43 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f
Apr 09 10:40:43 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:43 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-7e636f53-1170-43fb-88fe-e35a659d6c82-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f" returned: 0 in 0.608s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-7e636f53-1170-43fb-88fe-e35a659d6c82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:44 devstack sudo[84795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f
Apr 09 10:40:44 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-7e636f53-1170-43fb-88fe-e35a659d6c82" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-7e636f53-1170-43fb-88fe-e35a659d6c82" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Deleting offline snapshot 7e636f53-1170-43fb-88fe-e35a659d6c82 of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] snapshot_file for this snap is: volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[67470eb3-f841-4cb3-b7a6-02e45e1e8cef]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:44 devstack sudo[84797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82
Apr 09 10:40:44 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:44 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-54077501-8967-4aad-944d-ec66c576495f" returned: 0 in 0.540s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Lock "cinder-quobyte-54077501-8967-4aad-944d-ec66c576495f" released by "delete_volume" :: held 1.174s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Acquiring lock "cinder-quobyte-e0393e53-59af-455c-ba93-4f5c4ffe2357" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Lock "cinder-quobyte-e0393e53-59af-455c-ba93-4f5c4ffe2357" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f3ddd-dc92-4ed8-aa68-add3b30c2e3e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:44 devstack sudo[84806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357
Apr 09 10:40:44 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:44 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82" returned: 0 in 0.681s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866b68e-f636-4405-b714-580cfe1942a7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:44 devstack sudo[84812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:44 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:45 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357" returned: 0 in 0.717s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:45 devstack sudo[84845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357
Apr 09 10:40:45 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:45 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.734s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:45 devstack sudo[84850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82
Apr 09 10:40:45 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:45 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e0393e53-59af-455c-ba93-4f5c4ffe2357" returned: 0 in 0.714s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Lock "cinder-quobyte-e0393e53-59af-455c-ba93-4f5c4ffe2357" released by "delete_volume" :: held 1.468s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Created reservations ['d2f7494e-7eed-4bdf-82af-9302179f0327'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:46 devstack cinder-volume[82783]: WARNING cinder.quota [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-347990772 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-347990772, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:46 devstack cinder-volume[82783]: WARNING cinder.quota [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-347990772 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-347990772, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Created reservations ['50513881-76f2-47e1-a021-d861f98b3c24', '13f079e2-e4b2-4955-9d1e-3061e66fb8e6', '98d76e95-205c-4751-ac14-fb16956869c1', '81b66277-3085-4125-b19e-27df539549eb'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Created reservations ['48e62eb1-1cdf-41e6-8496-d24dc9124adc', 'e932fe71-b517-4da0-879c-c5332a7d8082', 'a00543e8-c394-4cc2-9aa6-ec8d769fb4d2', '467f40c2-dc01-4795-a6f7-bc77c8f33105'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:46 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82" returned: 0 in 0.840s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:46 devstack sudo[84856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82
Apr 09 10:40:46 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:46 devstack sudo[84858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:40:46 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:46 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.7e636f53-1170-43fb-88fe-e35a659d6c82" returned: 0 in 0.637s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-7e636f53-1170-43fb-88fe-e35a659d6c82" released by "_delete_snapshot" :: held 2.942s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" released by "delete_snapshot" :: held 2.959s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:46 devstack cinder-volume[82783]: WARNING cinder.quota [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Created reservations ['b2d1a395-5966-48d2-9044-7a33e2659441', '126e07a7-a228-4114-8de8-dfa407d258e1', 'eb1a247b-4e5d-426c-ab68-94ce0410525e', 'ced04c0f-a8c5-4bf2-b329-758ac4886b0e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:47 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Delete snapshot completed successfully.
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a698c47f-287a-4a6b-947b-fe0d6b51d743 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-7e636f53-1170-43fb-88fe-e35a659d6c82-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Creating offline snapshot 6cf34d37-67b9-4cd8-870e-ab1847b8e82f of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:40:47 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 1.371s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:40:47 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0f0a742d-3f30-49db-8c00-d11ce7012e10 tempest-GroupsTest-767719542 None] Delete group completed successfully.
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[96939be3-79ba-4819-8cc1-1d745e44b2aa]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:48 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:48 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:48 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.963s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:48 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f 1G
Apr 09 10:40:48 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:49 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f 1G" returned: 0 in 0.848s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:49 devstack sudo[84912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f
Apr 09 10:40:49 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:50 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f" returned: 0 in 0.761s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:50 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f is being set with open permissions: ugo+rw
Apr 09 10:40:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:50 devstack sudo[84924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f
Apr 09 10:40:50 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:51 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f" returned: 0 in 1.159s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.885s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f30ecd21-8a17-42eb-91c4-e0ba4225c623 tempest-SnapshotsActionsTest-230883483 None] Create snapshot completed successfully
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-6cf34d37-67b9-4cd8-870e-ab1847b8e82f-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-6cf34d37-67b9-4cd8-870e-ab1847b8e82f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-6cf34d37-67b9-4cd8-870e-ab1847b8e82f" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-6cf34d37-67b9-4cd8-870e-ab1847b8e82f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Deleting offline snapshot 6cf34d37-67b9-4cd8-870e-ab1847b8e82f of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] snapshot_file for this snap is: volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93586fa-adb4-4ab2-ba98-6e2b4cfc13d3]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:52 devstack sudo[84935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f
Apr 09 10:40:52 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:53 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f" returned: 0 in 0.814s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3805b4e-946c-4989-bf7b-b3e9822b2f24]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:53 devstack sudo[84940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:53 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:53 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.629s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:53 devstack sudo[84945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f
Apr 09 10:40:53 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:54 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f" returned: 0 in 0.749s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:54 devstack sudo[84954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f
Apr 09 10:40:54 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:55 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.6cf34d37-67b9-4cd8-870e-ab1847b8e82f" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-6cf34d37-67b9-4cd8-870e-ab1847b8e82f" released by "_delete_snapshot" :: held 2.791s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" released by "delete_snapshot" :: held 2.809s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Created reservations ['9cfed87a-730c-4fe5-a5ca-2109901e799e', '8ea6e775-f6f6-4033-b469-cf7e9913d96b', 'e55f1935-0d2b-40db-9237-7cb5077d0e77', '950e45c3-55ac-4c8b-9868-161ab6180333'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:40:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Delete snapshot completed successfully.
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7dae1f3d-8c48-4fc8-856b-a3fc8935676b tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-6cf34d37-67b9-4cd8-870e-ab1847b8e82f-delete_snapshot" released by "delete_snapshot" :: held 2.939s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Creating offline snapshot a464b8d6-675d-443b-993a-0428829628d7 of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7a7e0-fd4a-4b94-afe2-811507375b22]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:55 devstack sudo[84960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:40:55 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:56 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.820s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:56 devstack sudo[84966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 1G
Apr 09 10:40:56 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Flow 'volume_create_manager' (752cf737-9de5-4743-8ef0-1393b22ddecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119f22fc-0ef3-4e2d-9a76-7297802a2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119f22fc-0ef3-4e2d-9a76-7297802a2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-56505957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cb7be8-3984-4210-ab9f-f28f2e209ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aebea6a899b46b789008ddcd80705e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:57Z,use_quota=True,user_id='49a14eca153141129fda9935659fe785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099becff-9cd7-4ef0-a78b-d18a3455fc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099becff-9cd7-4ef0-a78b-d18a3455fc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a7fed4-62ab-4a76-820f-d0210f27509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a7fed4-62ab-4a76-820f-d0210f27509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8cb7be8-3984-4210-ab9f-f28f2e209ff0', 'volume_name': 'volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4929fa8-88b1-4f82-82bd-0f1bff07ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4929fa8-88b1-4f82-82bd-0f1bff07ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7b1e49-6cc2-4583-9a57-c8762b99b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Volume b8cb7be8-3984-4210-ab9f-f28f2e209ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0', 'volume_size': 1}
Apr 09 10:40:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:57 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 1G" returned: 0 in 0.724s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:57 devstack sudo[84971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7
Apr 09 10:40:57 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:58 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7" returned: 0 in 0.677s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:58 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 is being set with open permissions: ugo+rw
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:58 devstack sudo[84979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7
Apr 09 10:40:58 devstack sudo[84979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Flow 'volume_create_manager' (c9ccf670-852f-4390-8c3c-ff8704ec2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f118a9-30c1-4833-b54e-3789e46b3774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f118a9-30c1-4833-b54e-3789e46b3774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdce637-21b2-4189-be4c-2f4b48ea6fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124433cd0a004945adf7190db8ae066c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:58Z,use_quota=True,user_id='cc72ee9be2144c4c981e3ba8dcaf4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb4eed7-608d-4968-93d5-c71ade8eb6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb4eed7-608d-4968-93d5-c71ade8eb6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdc48b4-07a4-425e-b8bf-120241d6bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.image.glance [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Creating Keystone auth plugin from conf {{(pid=82783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdc48b4-07a4-425e-b8bf-120241d6bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4bdce637-21b2-4189-be4c-2f4b48ea6fb6', 'volume_name': 'volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f696210ad70>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1825e9af-c7c5-4f75-814f-f803bb171cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1825e9af-c7c5-4f75-814f-f803bb171cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c714e61c-3082-4fdd-ab98-e5444b58f22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:40:58 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Volume 4bdce637-21b2-4189-be4c-2f4b48ea6fb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f696210ad70>}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Trying to clone 4bdce637-21b2-4189-be4c-2f4b48ea6fb6 from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]). {{(pid=82783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 10:40:58 devstack sudo[84979]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7" returned: 0 in 0.577s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-56505957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cb7be8-3984-4210-ab9f-f28f2e209ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aebea6a899b46b789008ddcd80705e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:57Z,use_quota=True,user_id='49a14eca153141129fda9935659fe785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Creating volume b8cb7be8-3984-4210-ab9f-f28f2e209ff0 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:40:58 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:58 devstack sudo[85004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 1073741824
Apr 09 10:40:58 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f93dda0b-2b07-4e6e-b8a9-78c735bb459c tempest-SnapshotsActionsTest-230883483 None] Create snapshot completed successfully
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 10:40:58 devstack cinder-volume[82783]: INFO cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0471b1d-ac17-4fa3-8e8b-e6aaf092b4f0]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-a464b8d6-675d-443b-993a-0428829628d7-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-a464b8d6-675d-443b-993a-0428829628d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-a464b8d6-675d-443b-993a-0428829628d7" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-a464b8d6-675d-443b-993a-0428829628d7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:40:59 devstack sudo[85008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD
Apr 09 10:40:59 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Deleting offline snapshot a464b8d6-675d-443b-993a-0428829628d7 of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] snapshot_file for this snap is: volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dcd2fb-409b-410a-ad42-d3f9218ec661]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:59 devstack sudo[85014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7
Apr 09 10:40:59 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:59 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 1073741824" returned: 0 in 0.885s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:40:59 devstack sudo[85028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0
Apr 09 10:40:59 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:40:59 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 is fetched for user cc72ee9be2144c4c981e3ba8dcaf4901. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1605c05-cf69-4db3-adaa-536fc664f71a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:40:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:00 devstack sudo[85035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD
Apr 09 10:41:00 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:00 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7" returned: 0 in 0.936s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865127d-7ed6-4c7b-8346-dd302e721aa4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:00 devstack sudo[85037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:41:00 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:00 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0" returned: 0 in 0.940s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7b1e49-6cc2-4583-9a57-c8762b99b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284fe4c9-c6ab-40c9-bf1b-1f6cb917d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:00 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Volume volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 (b8cb7be8-3984-4210-ab9f-f28f2e209ff0): created successfully
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284fe4c9-c6ab-40c9-bf1b-1f6cb917d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Flow 'volume_create_manager' (752cf737-9de5-4743-8ef0-1393b22ddecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:00 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2c1e3da1-ed8b-401c-8a10-f977465c0459 tempest-VolumesServicesTestJSON-122415484 None] Created volume successfully.
Apr 09 10:41:00 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:40:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdce637-21b2-4189-be4c-2f4b48ea6fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124433cd0a004945adf7190db8ae066c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:40:58Z,use_quota=True,user_id='cc72ee9be2144c4c981e3ba8dcaf4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Creating volume 4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:00 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:00 devstack sudo[85043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 1073741824
Apr 09 10:41:00 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:00 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.829s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:41:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:00 devstack sudo[85049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7
Apr 09 10:41:00 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Acquiring lock "cinder-b8cb7be8-3984-4210-ab9f-f28f2e209ff0-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:01 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Lock "cinder-b8cb7be8-3984-4210-ab9f-f28f2e209ff0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 1073741824" returned: 0 in 0.740s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Acquiring lock "cinder-quobyte-b8cb7be8-3984-4210-ab9f-f28f2e209ff0" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Lock "cinder-quobyte-b8cb7be8-3984-4210-ab9f-f28f2e209ff0" acquired by "delete_volume" :: waited 0.058s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:01 devstack sudo[85065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:01 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef77f6-e135-46c7-b4a5-b15e5680944d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:01 devstack sudo[85067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0
Apr 09 10:41:01 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:01 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7" returned: 0 in 1.010s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:01 devstack sudo[85078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7
Apr 09 10:41:01 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:02 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 0 in 0.677s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:02 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0" returned: 0 in 0.630s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:02 devstack sudo[85085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0
Apr 09 10:41:02 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Attempting download of f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 4bdce637-21b2-4189-be4c-2f4b48ea6fb6. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ad7a4-c571-425b-a375-47fd25c6fa85]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:02 devstack sudo[85087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2
Apr 09 10:41:02 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:02 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.a464b8d6-675d-443b-993a-0428829628d7" returned: 0 in 0.535s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-a464b8d6-675d-443b-993a-0428829628d7" released by "_delete_snapshot" :: held 3.371s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" released by "delete_snapshot" :: held 3.387s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Created reservations ['8d15a344-1bd7-479a-b7c8-333ac6aaec9d', '0bb5799d-55ba-4f26-a1c5-e6ae59ce663a', '865c4083-0f4c-47be-be22-0500be0a1ca3', 'bc3b28c2-7b90-4afe-8570-29be69bdefe4'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Delete snapshot completed successfully.
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-589b6940-e3e1-4185-89c4-8e86a1dc8088 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-a464b8d6-675d-443b-993a-0428829628d7-delete_snapshot" released by "delete_snapshot" :: held 3.484s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:02 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b8cb7be8-3984-4210-ab9f-f28f2e209ff0" returned: 0 in 0.535s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Lock "cinder-quobyte-b8cb7be8-3984-4210-ab9f-f28f2e209ff0" released by "delete_volume" :: held 1.204s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:02 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Created reservations ['378148ce-19bf-4d5e-9dd2-5a444be6d67c', 'bdacc6e0-2e5e-441b-9383-ba1634bd6f7e', '7235561d-4feb-400b-9583-ad26d10dd7a2', 'd10c7912-606d-4333-b7a6-4a69476a4cba'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:02 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2
Apr 09 10:41:02 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:02 devstack sudo[85095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:02 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:03 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2" returned: 1 in 0.575s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_vneieyy2' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f7fbcd-b3d1-420d-9eb0-25095c0bffb2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:03 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.485s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:03 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Deleted volume successfully.
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3aac4738-e0e1-4a9e-81f0-048c37d83223 tempest-VolumesServicesTestJSON-122415484 None] Lock "cinder-b8cb7be8-3984-4210-ab9f-f28f2e209ff0-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:03 devstack sudo[85101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD
Apr 09 10:41:03 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Creating offline snapshot be8b72f0-4290-44d5-9c9d-0927f2490a6f of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[676338bb-e66d-4cce-a463-882da9893ed1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:03 devstack sudo[85103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:41:03 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:04 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD" returned: 0 in 0.672s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:04 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] f4151152-a1b9-4cc0-94ca-126b9fa272f6 was qcow2, converting to raw {{(pid=82783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 10:41:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:04 devstack sudo[85108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:04 devstack sudo[85108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:04 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.733s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:41:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:04 devstack sudo[85113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f 1G
Apr 09 10:41:04 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:05 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f 1G" returned: 0 in 0.781s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:05 devstack sudo[85125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f
Apr 09 10:41:05 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:05 devstack sudo[85108]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 0 in 1.138s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v0loxsfudevstack@QuobyteHD, size 112.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:41:05 devstack cinder-volume[82783]: INFO cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Converted 112.00 MB image at 98.27 MB/s
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:05 devstack sudo[85127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 1G
Apr 09 10:41:05 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:05 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 1G" returned: 0 in 0.728s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:05 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f" returned: 0 in 0.814s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:05 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f is being set with open permissions: ugo+rw
Apr 09 10:41:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:06 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7efbaa-f420-4a13-831c-870aea4d5e39]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:06 devstack sudo[85135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f
Apr 09 10:41:06 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:06 devstack sudo[85136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:06 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:06 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 0 in 0.754s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:06 devstack sudo[85168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:06 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:07 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f" returned: 0 in 1.121s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.559s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:07 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-46c7027b-bc93-4bcc-9a21-f8682e648e5a tempest-SnapshotsActionsTest-230883483 None] Create snapshot completed successfully
Apr 09 10:41:07 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 1 in 0.938s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Downloaded image f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 4bdce637-21b2-4189-be4c-2f4b48ea6fb6 successfully. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 for user cc72ee9be2144c4c981e3ba8dcaf4901 is deleted. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Marking volume 4bdce637-21b2-4189-be4c-2f4b48ea6fb6 as bootable. {{(pid=82783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Copying metadata from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 to 4bdce637-21b2-4189-be4c-2f4b48ea6fb6. {{(pid=82783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Creating volume glance metadata for volume 4bdce637-21b2-4189-be4c-2f4b48ea6fb6 backed by image f4151152-a1b9-4cc0-94ca-126b9fa272f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c714e61c-3082-4fdd-ab98-e5444b58f22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f696210ad70>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2eccc5-9ac0-4fc5-bcc0-08b96ddbd67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:07 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Volume volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 (4bdce637-21b2-4189-be4c-2f4b48ea6fb6): created successfully
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2eccc5-9ac0-4fc5-bcc0-08b96ddbd67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Flow 'volume_create_manager' (c9ccf670-852f-4390-8c3c-ff8704ec2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:07 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-26790f17-a6d6-4b9b-9e45-12424dc6a888 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Created volume successfully.
Apr 09 10:41:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-be8b72f0-4290-44d5-9c9d-0927f2490a6f-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-be8b72f0-4290-44d5-9c9d-0927f2490a6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Acquiring lock "cinder-quobyte-be8b72f0-4290-44d5-9c9d-0927f2490a6f" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-be8b72f0-4290-44d5-9c9d-0927f2490a6f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Deleting offline snapshot be8b72f0-4290-44d5-9c9d-0927f2490a6f of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] snapshot_file for this snap is: volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed67311-beca-410b-a6e6-67cc5d43f866]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:08 devstack sudo[85176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f
Apr 09 10:41:08 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:09 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f" returned: 0 in 1.097s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:41:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff06b69e-3f9f-4ccd-b9dc-6037eba76cb4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:09 devstack sudo[85182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:41:09 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:10 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.999s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:41:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:10 devstack sudo[85191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f
Apr 09 10:41:10 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[49680baa-eab8-4fd2-9f4b-21c1edcefc7d]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:11 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f" returned: 0 in 0.807s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:11 devstack sudo[85207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f
Apr 09 10:41:11 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:11 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:11 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:11 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.be8b72f0-4290-44d5-9c9d-0927f2490a6f" returned: 0 in 0.612s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-be8b72f0-4290-44d5-9c9d-0927f2490a6f" released by "_delete_snapshot" :: held 3.687s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" released by "delete_snapshot" :: held 3.715s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Created reservations ['947cfb2c-1a92-46fc-ae54-a8d439c3eb1a', '79e8fcdb-6aaa-4cde-a6c0-332b13be2e00', '6d29bc29-8bfd-4504-b35d-4481de9bf532', '257d3ee3-8261-49e0-a1a9-4ab599867171'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Delete snapshot completed successfully.
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83fddf53-b319-4424-8afa-fc4d4d5fb879 tempest-SnapshotsActionsTest-1645466355 None] Lock "cinder-be8b72f0-4290-44d5-9c9d-0927f2490a6f-delete_snapshot" released by "delete_snapshot" :: held 3.845s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:11 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 0 in 0.816s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:11 devstack sudo[85213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:11 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:12 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 1 in 0.553s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.412s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427', 'name': 'volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58c63d0b-92b7-4ee7-ae95-5718767a9611', 'enforce_multipath': True} {{(pid=82783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 10:41:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-0ed8a712-f68c-4bfe-88a1-07c34ccfcef4 req-f470d688-ffa8-4191-9e76-911e317ee98b tempest-ServerBootFromVolumeStableRescueTest-341928854 None] attachment_update completed successfully.
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "cinder-520023b9-7510-40c1-a6bb-02c9129d7112-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-520023b9-7510-40c1-a6bb-02c9129d7112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "cinder-quobyte-520023b9-7510-40c1-a6bb-02c9129d7112" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-quobyte-520023b9-7510-40c1-a6bb-02c9129d7112" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Deleting offline snapshot 520023b9-7510-40c1-a6bb-02c9129d7112 of volume d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] snapshot_file for this snap is: volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7a796d-9d5c-4f14-9982-8b462aeaba54]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:12 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:41:12 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:13 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:41:13 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d8f48b-c334-4108-be5d-2fdaf5950169]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:13 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f
Apr 09 10:41:13 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:14 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f" returned: 0 in 0.566s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:14 devstack sudo[85229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:41:14 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:14 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.513s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:14 devstack sudo[85234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112
Apr 09 10:41:14 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:15 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f.520023b9-7510-40c1-a6bb-02c9129d7112" returned: 0 in 0.627s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-quobyte-520023b9-7510-40c1-a6bb-02c9129d7112" released by "_delete_snapshot" :: held 2.319s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" released by "delete_snapshot" :: held 2.335s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:15 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Created reservations ['d70ae947-33bb-456f-95d5-64b10df0dd3f', 'f16c4433-1327-45cd-bf75-1c0b95ea57a3', '518f938c-bb0e-4bd3-a99c-b0ec45e78f6b', 'e57487a5-e624-4218-b975-e3869e8bd520'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:15 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Delete snapshot completed successfully.
Apr 09 10:41:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01d26ab8-49f4-41cc-a531-b2feb7f6a376 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-520023b9-7510-40c1-a6bb-02c9129d7112-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "cinder-d109a4a7-061a-4c7c-beeb-fa10c60a563f-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-d109a4a7-061a-4c7c-beeb-fa10c60a563f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271e8fb-2927-4cf9-86f0-dce6ad5d2f46]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:16 devstack sudo[85242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f
Apr 09 10:41:16 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:17 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f" returned: 0 in 1.084s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:17 devstack sudo[85262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f
Apr 09 10:41:17 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:18 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d109a4a7-061a-4c7c-beeb-fa10c60a563f" returned: 0 in 0.929s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-quobyte-d109a4a7-061a-4c7c-beeb-fa10c60a563f" released by "delete_volume" :: held 2.072s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Created reservations ['aeb42f34-d5ee-405e-884d-d710b01946bb', '6183dc07-c079-4b80-8805-6b753786ab48', 'ddb68221-c2dc-48f4-9cc2-9249e4bcc22a', '949bc3ca-c3e4-4e0b-9b37-54cb372e9293'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:18 devstack sudo[85288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:18 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:19 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.747s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:19 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:19 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Deleted volume successfully.
Apr 09 10:41:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48855a44-9137-4c9d-bb94-26ca4612db10 tempest-SnapshotsActionsTest-230883483 None] Lock "cinder-d109a4a7-061a-4c7c-beeb-fa10c60a563f-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:28 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:DELETE=2,cinder:SELECT=90,cinder:UPDATE=72,cinder:INSERT=34 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:41:29 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:INSERT=20,cinder:DELETE=9 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Flow 'volume_create_manager' (bda32639-b8a9-4a86-a412-c23a8489d3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63568990-7675-43e7-9216-3f834c91ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63568990-7675-43e7-9216-3f834c91ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-330052255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d9faea-5903-4d2f-84b5-f0e0b0a14022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814e8ae663404ed59f4b5cc9b24ad53d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:32Z,use_quota=True,user_id='33a8dfd2d08d46ac887652295eedd7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea96e9be-f9fe-473c-87b6-b2d9bdfc2f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea96e9be-f9fe-473c-87b6-b2d9bdfc2f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f6ac69-baf3-4ade-a6a2-38df53c74d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f6ac69-baf3-4ade-a6a2-38df53c74d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d9faea-5903-4d2f-84b5-f0e0b0a14022', 'volume_name': 'volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b255680-b3d6-44cb-8e9d-3603c2fdb430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b255680-b3d6-44cb-8e9d-3603c2fdb430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3148096d-620d-4a27-9797-7749ecea48de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Volume c6d9faea-5903-4d2f-84b5-f0e0b0a14022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022', 'volume_size': 1}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-330052255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d9faea-5903-4d2f-84b5-f0e0b0a14022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814e8ae663404ed59f4b5cc9b24ad53d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:32Z,use_quota=True,user_id='33a8dfd2d08d46ac887652295eedd7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Creating volume c6d9faea-5903-4d2f-84b5-f0e0b0a14022 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:32 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:32 devstack sudo[85398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 1073741824
Apr 09 10:41:32 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:33 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 1073741824" returned: 0 in 1.057s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:33 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022
Apr 09 10:41:33 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:34 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022" returned: 0 in 0.602s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3148096d-620d-4a27-9797-7749ecea48de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016c5d72-83c7-45e4-ae9a-d5b07a1e737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Volume volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 (c6d9faea-5903-4d2f-84b5-f0e0b0a14022): created successfully
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016c5d72-83c7-45e4-ae9a-d5b07a1e737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Flow 'volume_create_manager' (bda32639-b8a9-4a86-a412-c23a8489d3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b587a5c0-92f6-40ed-bad9-b14094d650c8 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Created volume successfully.
Apr 09 10:41:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Acquiring lock "cinder-c6d9faea-5903-4d2f-84b5-f0e0b0a14022-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "cinder-c6d9faea-5903-4d2f-84b5-f0e0b0a14022-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Acquiring lock "cinder-quobyte-c6d9faea-5903-4d2f-84b5-f0e0b0a14022" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "cinder-quobyte-c6d9faea-5903-4d2f-84b5-f0e0b0a14022" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d88a5-71d9-4b65-aa33-e0280baa7fbe]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:36 devstack sudo[85428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022
Apr 09 10:41:36 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Flow 'volume_create_manager' (9d2044f4-03db-4d4f-a6aa-d57ddc1462ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2c9113-b419-4829-8030-ba1ea92054a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2c9113-b419-4829-8030-ba1ea92054a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1042926395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaeaf02a-bdae-4237-b4a9-673d34adf642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375f4799e04147fd9871a18f4df8a7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:36Z,use_quota=True,user_id='f9844bdcb48e44aebc8d066fb2b921c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208433e6-45eb-4dff-9ad3-2ed70166f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208433e6-45eb-4dff-9ad3-2ed70166f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a0014c-4203-4f94-bda5-478d08fcb1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a0014c-4203-4f94-bda5-478d08fcb1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaeaf02a-bdae-4237-b4a9-673d34adf642', 'volume_name': 'volume-aaeaf02a-bdae-4237-b4a9-673d34adf642', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde0cd71-77d6-4670-8943-e02a3654d7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde0cd71-77d6-4670-8943-e02a3654d7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832dc706-69cc-4800-8b2e-7357aecf75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:36 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Volume aaeaf02a-bdae-4237-b4a9-673d34adf642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaeaf02a-bdae-4237-b4a9-673d34adf642', 'volume_size': 1}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1042926395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaeaf02a-bdae-4237-b4a9-673d34adf642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375f4799e04147fd9871a18f4df8a7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:36Z,use_quota=True,user_id='f9844bdcb48e44aebc8d066fb2b921c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Creating volume aaeaf02a-bdae-4237-b4a9-673d34adf642 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:36 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:36 devstack sudo[85430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 1073741824
Apr 09 10:41:36 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:36 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022" returned: 0 in 0.884s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:36 devstack sudo[85438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022
Apr 09 10:41:36 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:36 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 1073741824" returned: 0 in 0.715s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:37 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642
Apr 09 10:41:37 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:37 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c6d9faea-5903-4d2f-84b5-f0e0b0a14022" returned: 0 in 0.663s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "cinder-quobyte-c6d9faea-5903-4d2f-84b5-f0e0b0a14022" released by "delete_volume" :: held 1.573s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:37 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642" returned: 0 in 0.484s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Created reservations ['69e6d0da-7d48-479a-a355-e848406385cc', 'ad2af60d-5917-47fd-bf2a-e6d454af77b7', '2b5b4685-d083-48ed-8e21-0a73fab2783c', '3817cecd-645f-4282-9deb-764b99dc6863'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832dc706-69cc-4800-8b2e-7357aecf75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaeaf02a-bdae-4237-b4a9-673d34adf642', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b594537-0245-4923-ac1b-552fb403c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Volume volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 (aaeaf02a-bdae-4237-b4a9-673d34adf642): created successfully
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b594537-0245-4923-ac1b-552fb403c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Flow 'volume_create_manager' (9d2044f4-03db-4d4f-a6aa-d57ddc1462ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e7c84e88-5a60-4457-90b7-a6656739b7e0 tempest-ServersNegativeTestJSON-1571700936 None] Created volume successfully.
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:37 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:37 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:38 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:38 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Deleted volume successfully.
Apr 09 10:41:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-94ffcbc3-95f2-492d-b15a-6092bad97745 tempest-VolumeQuotasNegativeTestJSON-1703353144 None] Lock "cinder-c6d9faea-5903-4d2f-84b5-f0e0b0a14022-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:39 devstack sudo[85478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:39 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Flow 'volume_create_manager' (54690bc7-490c-466a-80f5-629d7df71b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d73d87-1e70-457f-b999-283221aa1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d73d87-1e70-457f-b999-283221aa1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1427795203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375f4799e04147fd9871a18f4df8a7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:40Z,use_quota=True,user_id='f9844bdcb48e44aebc8d066fb2b921c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d3c7b6-b636-4c73-b62d-88be26fb2a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d3c7b6-b636-4c73-b62d-88be26fb2a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b7f646-452f-46a0-ad67-ac0fb5e226d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b7f646-452f-46a0-ad67-ac0fb5e226d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df', 'volume_name': 'volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d812833-64ab-4611-bd49-a6418e3a6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d812833-64ab-4611-bd49-a6418e3a6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2055423-e1c5-4f24-ad65-4ba8b515b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:39 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Volume 2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df', 'volume_size': 1}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1427795203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375f4799e04147fd9871a18f4df8a7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:40Z,use_quota=True,user_id='f9844bdcb48e44aebc8d066fb2b921c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Creating volume 2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:39 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:40 devstack sudo[85480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df 1073741824
Apr 09 10:41:40 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:40 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.876s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:41 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df 1073741824" returned: 0 in 1.071s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:41 devstack sudo[85487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df
Apr 09 10:41:41 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:41 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2055423-e1c5-4f24-ad65-4ba8b515b522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a66ffe-4631-4124-8d8b-be4d52213051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:41 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Volume volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df (2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df): created successfully
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a66ffe-4631-4124-8d8b-be4d52213051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Flow 'volume_create_manager' (54690bc7-490c-466a-80f5-629d7df71b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8abc8322-2623-4f70-9906-e3940437c341 tempest-ServersNegativeTestJSON-1571700936 None] Created volume successfully.
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "cinder-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "cinder-quobyte-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-quobyte-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df" acquired by "delete_volume" :: waited 0.041s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0e4a0-dc3b-44b6-a524-66effb1c67c8]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:43 devstack sudo[85491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df
Apr 09 10:41:43 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:43 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Flow 'volume_create_manager' (47cd2a99-817e-4d96-84c5-0afd5108f58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15ed111-919a-4ce0-827d-cc09ac2d5dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15ed111-919a-4ce0-827d-cc09ac2d5dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-248273576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54c0745-e8d0-49bf-986c-65e8534e60d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0add787f863b4c28a11605a9e9d08050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:44Z,use_quota=True,user_id='fa76acd06e6f4130b1a16dd697ee513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdf09a31-eefe-4541-9d0f-aaaa3fba6985),volume_type_id=bdf09a31-eefe-4541-9d0f-aaaa3fba6985)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe91f6d5-9746-48ea-a4ee-dc484f70fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe91f6d5-9746-48ea-a4ee-dc484f70fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0ed079-7691-4116-bc68-27d30239468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0ed079-7691-4116-bc68-27d30239468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54c0745-e8d0-49bf-986c-65e8534e60d2', 'volume_name': 'volume-f54c0745-e8d0-49bf-986c-65e8534e60d2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8518c25-9f87-4e14-a576-0e155e88b2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8518c25-9f87-4e14-a576-0e155e88b2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc8ffc3-e116-4cbc-9e2b-4680a2054d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:44 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Volume f54c0745-e8d0-49bf-986c-65e8534e60d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54c0745-e8d0-49bf-986c-65e8534e60d2', 'volume_size': 1}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-248273576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54c0745-e8d0-49bf-986c-65e8534e60d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0add787f863b4c28a11605a9e9d08050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:44Z,use_quota=True,user_id='fa76acd06e6f4130b1a16dd697ee513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdf09a31-eefe-4541-9d0f-aaaa3fba6985),volume_type_id=bdf09a31-eefe-4541-9d0f-aaaa3fba6985)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Creating volume f54c0745-e8d0-49bf-986c-65e8534e60d2 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:44 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:44 devstack sudo[85499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 1073741824
Apr 09 10:41:44 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:44 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df" returned: 0 in 1.481s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:44 devstack sudo[85525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df
Apr 09 10:41:44 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:44 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 1073741824" returned: 0 in 0.692s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:45 devstack sudo[85527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2
Apr 09 10:41:45 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:45 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df" returned: 0 in 0.581s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-quobyte-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df" released by "delete_volume" :: held 2.125s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Created reservations ['dbb6b9d5-ce76-4eef-9d4c-8779b43a0673', '512c6c72-d47b-4201-8c19-e8c8267a262b', '472d397b-d6d5-4720-9a6f-63fbfcc41c1e', '861baa41-6fe0-46de-aea7-8657a801c1d8'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:45 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2" returned: 0 in 0.642s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:45 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:45 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc8ffc3-e116-4cbc-9e2b-4680a2054d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54c0745-e8d0-49bf-986c-65e8534e60d2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf00657c-8f5d-443a-8ea9-bab1b7ac6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:45 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Volume volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 (f54c0745-e8d0-49bf-986c-65e8534e60d2): created successfully
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf00657c-8f5d-443a-8ea9-bab1b7ac6154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Flow 'volume_create_manager' (47cd2a99-817e-4d96-84c5-0afd5108f58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5795b838-5222-445f-b175-d1c37c302a01 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Created volume successfully.
Apr 09 10:41:46 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.654s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Deleted volume successfully.
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-eb559d68-e145-421f-ac02-8f0552c2979e tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-2ab6d2d3-0be2-46cb-8ecb-6cfdb0da78df-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:46 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:46 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "cinder-aaeaf02a-bdae-4237-b4a9-673d34adf642-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-aaeaf02a-bdae-4237-b4a9-673d34adf642-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "cinder-quobyte-aaeaf02a-bdae-4237-b4a9-673d34adf642" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-quobyte-aaeaf02a-bdae-4237-b4a9-673d34adf642" acquired by "delete_volume" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3184b744-5625-4b7c-9660-73d6b0ff1103]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:46 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642
Apr 09 10:41:46 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:47 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.647s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:47 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:47 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fcac9880-bc77-4b33-8fc3-c024823589bc tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Retype volume completed successfully.
Apr 09 10:41:47 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642" returned: 0 in 0.723s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:47 devstack sudo[85603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642
Apr 09 10:41:47 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Acquiring lock "cinder-f54c0745-e8d0-49bf-986c-65e8534e60d2-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "cinder-f54c0745-e8d0-49bf-986c-65e8534e60d2-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Acquiring lock "cinder-quobyte-f54c0745-e8d0-49bf-986c-65e8534e60d2" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "cinder-quobyte-f54c0745-e8d0-49bf-986c-65e8534e60d2" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9f850c-b73f-4196-990f-91a364ea0578]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:48 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aaeaf02a-bdae-4237-b4a9-673d34adf642" returned: 0 in 0.878s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-quobyte-aaeaf02a-bdae-4237-b4a9-673d34adf642" released by "delete_volume" :: held 1.632s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:48 devstack sudo[85633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2
Apr 09 10:41:48 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Created reservations ['c227917d-eba7-43db-b83f-50ce5e4be074', 'ecc05c5f-2f21-4442-a5a8-81b3eab6af57', '2d2ad892-cfd8-42c8-960e-1ab990b7d1e2', '103bb7c8-1a7a-4f81-b631-9ad1d10cc0e8'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:48 devstack sudo[85635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:48 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:48 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2" returned: 0 in 0.495s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:48 devstack sudo[85644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2
Apr 09 10:41:48 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:49 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.565s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Deleted volume successfully.
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0e143579-0141-469d-a82a-0436a3f79172 tempest-ServersNegativeTestJSON-1571700936 None] Lock "cinder-aaeaf02a-bdae-4237-b4a9-673d34adf642-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:49 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f54c0745-e8d0-49bf-986c-65e8534e60d2" returned: 0 in 0.557s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "cinder-quobyte-f54c0745-e8d0-49bf-986c-65e8534e60d2" released by "delete_volume" :: held 1.093s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:49 devstack cinder-volume[82783]: WARNING cinder.quota [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:41:49 devstack cinder-volume[82783]: WARNING cinder.quota [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Created reservations ['a0fe47b7-ef0b-4fc3-ae85-3165b4327ca0', 'ea7c2ced-cf23-4952-8c1c-bb26a2538440', '9f16bf22-f40e-4105-b4cf-0f5ae2ce81c5', '919b1b48-ec7d-432f-ac76-b4e8285a6a8b'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:49 devstack sudo[85672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:49 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:49 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.455s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Deleted volume successfully.
Apr 09 10:41:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-80698c17-9ff7-4cfc-abb8-15297a1e0186 tempest-VolumeRetypeWithoutMigrationTest-1068156666 None] Lock "cinder-f54c0745-e8d0-49bf-986c-65e8534e60d2-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-01ebb7f9-c5cb-435b-a0b9-c2de5f140143 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Terminate volume connection completed successfully.
Apr 09 10:41:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-01ebb7f9-c5cb-435b-a0b9-c2de5f140143 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Deleting attachment 58c63d0b-92b7-4ee7-ae95-5718767a9611. {{(pid=82783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "cinder-4bdce637-21b2-4189-be4c-2f4b48ea6fb6-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-4bdce637-21b2-4189-be4c-2f4b48ea6fb6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "cinder-quobyte-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-quobyte-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[392acb25-0614-41fd-b930-fa1d5a1a8a6e]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:52 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:52 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:52 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 0 in 0.629s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:52 devstack sudo[85762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:52 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:53 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 1 in 0.603s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:41:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:53 devstack sudo[85767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6
Apr 09 10:41:53 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:54 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" returned: 0 in 0.602s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-quobyte-4bdce637-21b2-4189-be4c-2f4b48ea6fb6" released by "delete_volume" :: held 1.885s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG cinder.quota [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Created reservations ['83d610e8-cfd2-43db-88a2-b06d2ad760b7', '76edb106-e5e0-44d3-89ce-caf421355d44', '7c336f47-8dd7-4b6e-a292-c135c1f951cb', '13f80ab3-b919-411c-83c4-40958c783524'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:54 devstack sudo[85770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:41:54 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:54 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.499s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG cinder.manager [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:41:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Deleted volume successfully.
Apr 09 10:41:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-738d7f11-7d34-46f1-abd1-a174e9fd507d req-ce46cf04-a46a-45a1-8188-b07b2657b408 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-4bdce637-21b2-4189-be4c-2f4b48ea6fb6-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (f5bc2bda-30e4-4226-9e2c-83597fe13e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13922e3-0f0b-4f32-890a-52651033d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13922e3-0f0b-4f32-890a-52651033d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-348390584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564ae04f-1d9c-463e-b4d4-3b20c281f8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:55Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec950369-cea2-4b83-911c-72a4857cfe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec950369-cea2-4b83-911c-72a4857cfe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91def0a-e681-4c3e-80bb-7f8f416b37ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91def0a-e681-4c3e-80bb-7f8f416b37ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564ae04f-1d9c-463e-b4d4-3b20c281f8ea', 'volume_name': 'volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6b2594-6385-463c-9695-f7418379e462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6b2594-6385-463c-9695-f7418379e462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe98847-3302-4bdb-9734-7c3ad05624f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:55 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Volume 564ae04f-1d9c-463e-b4d4-3b20c281f8ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea', 'volume_size': 1}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-348390584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564ae04f-1d9c-463e-b4d4-3b20c281f8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:55Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Creating volume 564ae04f-1d9c-463e-b4d4-3b20c281f8ea {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:55 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:55 devstack sudo[85789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea 1073741824
Apr 09 10:41:55 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:56 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea 1073741824" returned: 0 in 0.803s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:56 devstack sudo[85798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea
Apr 09 10:41:56 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:56 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" returned: 0 in 0.507s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe98847-3302-4bdb-9734-7c3ad05624f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246033df-599b-4499-a4a4-0d6dc519a2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Volume volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea (564ae04f-1d9c-463e-b4d4-3b20c281f8ea): created successfully
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246033df-599b-4499-a4a4-0d6dc519a2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (f5bc2bda-30e4-4226-9e2c-83597fe13e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:56 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e6d39048-8762-4bf0-bf55-745ea0b60f92 tempest-VolumesActionsTest-1141904284 None] Created volume successfully.
Apr 09 10:41:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-55ca322d-4c79-4633-b03e-a80339961049 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" by "attach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-55ca322d-4c79-4633-b03e-a80339961049 tempest-VolumesActionsTest-1141904284 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" acquired by "attach_volume" :: waited 0.021s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-55ca322d-4c79-4633-b03e-a80339961049 tempest-VolumesActionsTest-1141904284 None] Attaching volume 564ae04f-1d9c-463e-b4d4-3b20c281f8ea to instance b554f801-b4ff-43de-8a77-bcfb2f015044 at mountpoint /dev/vdb on host None.
Apr 09 10:41:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-55ca322d-4c79-4633-b03e-a80339961049 tempest-VolumesActionsTest-1141904284 None] Attach volume completed successfully.
Apr 09 10:41:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-55ca322d-4c79-4633-b03e-a80339961049 tempest-VolumesActionsTest-1141904284 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" released by "attach_volume" :: held 0.176s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Flow 'volume_create_manager' (d1da1cbc-31b4-433e-b2a0-153161ac453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f52a614-6a87-47e8-aae9-f27846c9f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f52a614-6a87-47e8-aae9-f27846c9f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1036002633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a431ed34-5acd-46fd-8d64-2c04ff6072de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79171c4efe03442aa33fee1cd9b4956f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:58Z,use_quota=True,user_id='a2d6079c66be4ebaa0714194b234a0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae0c6ac-bf9c-458d-a244-2e8b99860500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae0c6ac-bf9c-458d-a244-2e8b99860500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeee7873-88d5-4d03-8166-3351d479ca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeee7873-88d5-4d03-8166-3351d479ca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a431ed34-5acd-46fd-8d64-2c04ff6072de', 'volume_name': 'volume-a431ed34-5acd-46fd-8d64-2c04ff6072de', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c376cec1-ddb3-4237-823f-923ae8e0a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c376cec1-ddb3-4237-823f-923ae8e0a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc494d1-5967-4594-84ea-1921a6b0f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:58 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Volume a431ed34-5acd-46fd-8d64-2c04ff6072de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a431ed34-5acd-46fd-8d64-2c04ff6072de', 'volume_size': 1}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1036002633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a431ed34-5acd-46fd-8d64-2c04ff6072de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79171c4efe03442aa33fee1cd9b4956f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:41:58Z,use_quota=True,user_id='a2d6079c66be4ebaa0714194b234a0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Creating volume a431ed34-5acd-46fd-8d64-2c04ff6072de {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:41:58 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:58 devstack sudo[85831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de 1073741824
Apr 09 10:41:58 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-048ee67e-ecd0-4181-a24b-28be7d282166 tempest-VolumesActionsTest-1998967844 None] Terminate volume connection completed successfully.
Apr 09 10:41:58 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de 1073741824" returned: 0 in 0.651s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:41:58 devstack sudo[85837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de
Apr 09 10:41:58 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-048ee67e-ecd0-4181-a24b-28be7d282166 tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-detach_volume" by "detach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-048ee67e-ecd0-4181-a24b-28be7d282166 tempest-VolumesActionsTest-1998967844 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-048ee67e-ecd0-4181-a24b-28be7d282166 tempest-VolumesActionsTest-1998967844 None] Detaching volume 564ae04f-1d9c-463e-b4d4-3b20c281f8ea from instance b554f801-b4ff-43de-8a77-bcfb2f015044.
Apr 09 10:41:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-048ee67e-ecd0-4181-a24b-28be7d282166 tempest-VolumesActionsTest-1998967844 None] Detach volume completed successfully.
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-048ee67e-ecd0-4181-a24b-28be7d282166 tempest-VolumesActionsTest-1998967844 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:41:59 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de" returned: 0 in 0.521s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc494d1-5967-4594-84ea-1921a6b0f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a431ed34-5acd-46fd-8d64-2c04ff6072de', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3235df9-529e-4ae6-995a-9bba9fa52412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:41:59 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Volume volume-a431ed34-5acd-46fd-8d64-2c04ff6072de (a431ed34-5acd-46fd-8d64-2c04ff6072de): created successfully
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3235df9-529e-4ae6-995a-9bba9fa52412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Flow 'volume_create_manager' (d1da1cbc-31b4-433e-b2a0-153161ac453d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:41:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e4d88506-d866-4547-ad67-bb5c832fc2b5 tempest-VolumesMetadataTest-1798549663 None] Created volume successfully.
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-369a27fe-05ef-4a0a-8628-a54caebe2c0b tempest-VolumesActionsTest-1141904284 None] Acquiring lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-detach_volume" by "detach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-369a27fe-05ef-4a0a-8628-a54caebe2c0b tempest-VolumesActionsTest-1141904284 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:41:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-369a27fe-05ef-4a0a-8628-a54caebe2c0b tempest-VolumesActionsTest-1141904284 None] Volume detach called, but volume not attached.
Apr 09 10:41:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-369a27fe-05ef-4a0a-8628-a54caebe2c0b tempest-VolumesActionsTest-1141904284 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Acquiring lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Acquiring lock "cinder-quobyte-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Lock "cinder-quobyte-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[17238b10-8462-4ee0-b37d-b76ed8366a4b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:00 devstack sudo[85842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea
Apr 09 10:42:00 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Acquiring lock "cinder-a431ed34-5acd-46fd-8d64-2c04ff6072de-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Lock "cinder-a431ed34-5acd-46fd-8d64-2c04ff6072de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Acquiring lock "cinder-quobyte-a431ed34-5acd-46fd-8d64-2c04ff6072de" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Lock "cinder-quobyte-a431ed34-5acd-46fd-8d64-2c04ff6072de" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c46f3f-b058-49af-976d-e0977a701627]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:01 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de
Apr 09 10:42:01 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:01 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" returned: 0 in 0.718s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:01 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea
Apr 09 10:42:01 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:01 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de" returned: 0 in 0.534s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:01 devstack sudo[85854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de
Apr 09 10:42:01 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:01 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Lock "cinder-quobyte-564ae04f-1d9c-463e-b4d4-3b20c281f8ea" released by "delete_volume" :: held 1.256s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Created reservations ['f95e20d3-4f58-4a1d-a643-ecbd75c97085', '1a9ef978-f34b-41b6-a1aa-d6afb3df5dc3', 'a23c76cf-cb86-4a68-abd7-72f7b8e4dd19', '72e5498f-23c2-4472-b925-049a07fbb762'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:01 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:01 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:02 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a431ed34-5acd-46fd-8d64-2c04ff6072de" returned: 0 in 0.546s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Lock "cinder-quobyte-a431ed34-5acd-46fd-8d64-2c04ff6072de" released by "delete_volume" :: held 1.108s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Created reservations ['e53a9fbb-c690-42a3-b3c7-4d0740940aeb', '93f2456f-3bf7-48f2-a633-7b9745cc8650', '1775a718-818c-4308-a286-46d67f62f91b', 'f417b24c-c771-469f-a769-4b8986dfea80'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:02 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:02 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:02 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.605s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Deleted volume successfully.
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4a2855f2-fff0-410b-892a-e107a7e35a9e tempest-VolumesActionsTest-1141904284 None] Lock "cinder-564ae04f-1d9c-463e-b4d4-3b20c281f8ea-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Flow 'volume_create_manager' (479a04d4-f309-4b03-b796-0f80af07e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2576673-9210-4126-bec7-800e4deaaedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2576673-9210-4126-bec7-800e4deaaedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1877796909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3477d09-10c2-48b2-8dd1-ad4f1181e45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2dc5ddac3c4f638802bf8b9ffeefae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:03Z,use_quota=True,user_id='c7a0c81335334d7e8bb415fe1f897c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dac54b1-6c34-4a79-83a0-c528da2eb63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dac54b1-6c34-4a79-83a0-c528da2eb63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f076a181-7bbd-44fa-b112-ee0390207c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f076a181-7bbd-44fa-b112-ee0390207c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3477d09-10c2-48b2-8dd1-ad4f1181e45e', 'volume_name': 'volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4a0c2a-e38c-4784-a446-ea42c64d2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4a0c2a-e38c-4784-a446-ea42c64d2907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7719ba00-4345-41ad-a1d2-ba92ca8c8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:02 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Volume a3477d09-10c2-48b2-8dd1-ad4f1181e45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e', 'volume_size': 1}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1877796909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3477d09-10c2-48b2-8dd1-ad4f1181e45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2dc5ddac3c4f638802bf8b9ffeefae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:03Z,use_quota=True,user_id='c7a0c81335334d7e8bb415fe1f897c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Creating volume a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:02 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:02 devstack sudo[85865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e 1073741824
Apr 09 10:42:02 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:02 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.732s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:02 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Deleted volume successfully.
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3b7518f5-493a-499e-ae14-b9bd8e8e8014 tempest-VolumesMetadataTest-1798549663 None] Lock "cinder-a431ed34-5acd-46fd-8d64-2c04ff6072de-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:03 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e 1073741824" returned: 0 in 0.617s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:03 devstack sudo[85873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e
Apr 09 10:42:03 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:03 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" returned: 0 in 0.562s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7719ba00-4345-41ad-a1d2-ba92ca8c8caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbff433a-926f-4c35-afac-e1864d7da251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:03 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Volume volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e (a3477d09-10c2-48b2-8dd1-ad4f1181e45e): created successfully
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbff433a-926f-4c35-afac-e1864d7da251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Flow 'volume_create_manager' (479a04d4-f309-4b03-b796-0f80af07e1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:03 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-839adffd-a1a2-49ba-9d18-4171f4f79ff9 req-ac95f3f4-eb32-4b2a-85a1-9c21e537dce6 tempest-VolumesSnapshotsTestJSON-409739579 None] Created volume successfully.
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Creating offline snapshot ea413cea-38ce-4570-8d1f-de4128b406aa of volume a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f545d3c-9767-4b35-aa30-f239b7f74117]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:05 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e
Apr 09 10:42:05 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:05 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" returned: 0 in 0.700s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:05 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa 1G
Apr 09 10:42:05 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:06 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-c32b699b-337d-48fc-88de-7a385edac86d tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Terminate volume connection completed successfully.
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-c32b699b-337d-48fc-88de-7a385edac86d tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Deleting attachment 727d507e-c03e-40be-84ae-19c54db4feb3. {{(pid=82783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 10:42:06 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa 1G" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:06 devstack sudo[85954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa
Apr 09 10:42:06 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Flow 'volume_create_manager' (6cb195b9-f678-4282-8cc0-dabc4fe54b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43679c7-00c1-48bf-acf5-fbd737ee7197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43679c7-00c1-48bf-acf5-fbd737ee7197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1656081439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a5fec8-123e-427d-b55b-6ca70d04ca19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e04a6c3af4932a52912581b12698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:07Z,use_quota=True,user_id='23f1ce6fce9d4e9fa4399a0de95d3ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00e2988-74c5-4915-9ff7-c93f2a9c4f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00e2988-74c5-4915-9ff7-c93f2a9c4f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def3fcb9-2e45-442f-b56a-6e48ec7ad29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def3fcb9-2e45-442f-b56a-6e48ec7ad29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a5fec8-123e-427d-b55b-6ca70d04ca19', 'volume_name': 'volume-56a5fec8-123e-427d-b55b-6ca70d04ca19', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9546bb-5871-4cc6-9370-a1af9d3402b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9546bb-5871-4cc6-9370-a1af9d3402b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b8a708-d22b-46d8-a678-4c5425650390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Volume 56a5fec8-123e-427d-b55b-6ca70d04ca19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a5fec8-123e-427d-b55b-6ca70d04ca19', 'volume_size': 1}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "cinder-9ae2796b-8436-480b-9020-d384e86b87ca-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-9ae2796b-8436-480b-9020-d384e86b87ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "cinder-quobyte-9ae2796b-8436-480b-9020-d384e86b87ca" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-quobyte-9ae2796b-8436-480b-9020-d384e86b87ca" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:06 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa" returned: 0 in 0.565s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:06 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa is being set with open permissions: ugo+rw
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[766469ff-f875-4cd0-872c-7d49d9c757f8]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:06 devstack sudo[85960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa
Apr 09 10:42:06 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:07 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca
Apr 09 10:42:07 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:07 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa" returned: 0 in 0.419s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:07 devstack sudo[85968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info
Apr 09 10:42:07 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:07 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca" returned: 0 in 0.503s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:07 devstack sudo[85970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca
Apr 09 10:42:07 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:07 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:07 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info is being set with open permissions: ugo+rw
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:07 devstack sudo[85974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info
Apr 09 10:42:07 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:07 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9ae2796b-8436-480b-9020-d384e86b87ca" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-quobyte-9ae2796b-8436-480b-9020-d384e86b87ca" released by "delete_volume" :: held 0.987s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG cinder.quota [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Created reservations ['e8c8f03e-33e4-4e70-86ce-a4e9f662f843', '6425019e-4330-4efe-83d6-b21b96445f6a', '198d8048-2cf2-42d3-b6be-c54945f77cc9', '2a1a641b-c262-4fb0-9777-010d4211da55'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:08 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:08 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:08 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.info" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.237s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1656081439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a5fec8-123e-427d-b55b-6ca70d04ca19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e04a6c3af4932a52912581b12698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:07Z,use_quota=True,user_id='23f1ce6fce9d4e9fa4399a0de95d3ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Creating volume 56a5fec8-123e-427d-b55b-6ca70d04ca19 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:08 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-d8abb330-84a6-4ee3-b075-0ab20f2c628b req-9132830b-5f70-4ff4-9b6b-b1931ab3f682 tempest-VolumesSnapshotsTestJSON-409739579 None] Create snapshot completed successfully
Apr 09 10:42:08 devstack sudo[85979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 1073741824
Apr 09 10:42:08 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:08 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.447s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.manager [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Deleted volume successfully.
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-946c5e1c-c1c8-4c8e-a519-3a4ba55790fc req-a6b6a600-19e6-4e14-9267-78c9cc776d52 tempest-ServerBootFromVolumeStableRescueTest-341928854 None] Lock "cinder-9ae2796b-8436-480b-9020-d384e86b87ca-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:08 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 1073741824" returned: 0 in 0.523s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "cinder-ea413cea-38ce-4570-8d1f-de4128b406aa-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-ea413cea-38ce-4570-8d1f-de4128b406aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "cinder-quobyte-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-quobyte-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "cinder-quobyte-ea413cea-38ce-4570-8d1f-de4128b406aa" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:08 devstack sudo[85985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19
Apr 09 10:42:08 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-quobyte-ea413cea-38ce-4570-8d1f-de4128b406aa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Deleting offline snapshot ea413cea-38ce-4570-8d1f-de4128b406aa of volume a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] snapshot_file for this snap is: volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf1c9fb-6424-4e84-afc9-059abe60a073]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:09 devstack sudo[85987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa
Apr 09 10:42:09 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:09 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19" returned: 0 in 0.458s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b8a708-d22b-46d8-a678-4c5425650390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a5fec8-123e-427d-b55b-6ca70d04ca19', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b6316e-def1-4806-84f9-289e498e838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (41c211dc-cd91-4515-9c57-f32b39451cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55461e6c-80f0-4d8c-9317-3c3307ee9347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:09 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Volume volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 (56a5fec8-123e-427d-b55b-6ca70d04ca19): created successfully
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b6316e-def1-4806-84f9-289e498e838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Flow 'volume_create_manager' (6cb195b9-f678-4282-8cc0-dabc4fe54b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55461e6c-80f0-4d8c-9317-3c3307ee9347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-651279648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed47bda-9e1b-447d-ad5c-527fdc0e19d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:09Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d367a03e-9711-4746-a284-33922b9e34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d367a03e-9711-4746-a284-33922b9e34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa62ab6-5e39-4930-b356-92ea754dd521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa62ab6-5e39-4930-b356-92ea754dd521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed47bda-9e1b-447d-ad5c-527fdc0e19d3', 'volume_name': 'volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcd47b4-48a8-4e81-96ac-f3227cdc389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcd47b4-48a8-4e81-96ac-f3227cdc389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95d1c06-fd61-45f2-8f1d-03679f311284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:09 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Volume bed47bda-9e1b-447d-ad5c-527fdc0e19d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3', 'volume_size': 1}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-651279648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed47bda-9e1b-447d-ad5c-527fdc0e19d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:09Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Creating volume bed47bda-9e1b-447d-ad5c-527fdc0e19d3 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:09 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:09 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:09 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-9b6b45b2-995d-4825-957e-8791fdb0519d tempest-VolumesTransfersV357Test-1176253983 None] Created volume successfully.
Apr 09 10:42:09 devstack sudo[85993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 1073741824
Apr 09 10:42:09 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa" returned: 0 in 0.557s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f04176f-d23f-4311-8555-1a3ff2ed1777]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:09 devstack sudo[85995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e
Apr 09 10:42:09 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:10 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 1073741824" returned: 0 in 0.525s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:10 devstack sudo[86003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3
Apr 09 10:42:10 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:10 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" returned: 0 in 0.572s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:10 devstack sudo[86005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa
Apr 09 10:42:10 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:10 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-06df9ce7-65e5-409a-9632-17f3038611e1 tempest-VolumesTransfersV357Test-2055949957 None] Transfer volume completed successfully.
Apr 09 10:42:10 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95d1c06-fd61-45f2-8f1d-03679f311284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdcb3fe-bba2-4d35-beaf-13a619bb4dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:10 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Volume volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 (bed47bda-9e1b-447d-ad5c-527fdc0e19d3): created successfully
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdcb3fe-bba2-4d35-beaf-13a619bb4dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (41c211dc-cd91-4515-9c57-f32b39451cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:10 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7d19331d-3e97-4db3-a76d-d89255201906 tempest-VolumesActionsTest-1141904284 None] Created volume successfully.
Apr 09 10:42:10 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa" returned: 0 in 0.568s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:10 devstack sudo[86012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa
Apr 09 10:42:10 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:11 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e.ea413cea-38ce-4570-8d1f-de4128b406aa" returned: 0 in 0.443s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-quobyte-ea413cea-38ce-4570-8d1f-de4128b406aa" released by "_delete_snapshot" :: held 2.196s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-quobyte-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" released by "delete_snapshot" :: held 2.209s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.quota [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Created reservations ['8768726e-33b3-48d0-a09f-df934fd5d2d8', '0eff0621-4bbb-4796-91ff-caeddc0e782c', '066c07af-4e13-40d8-86ce-5a1b7f8ba474', 'be499e37-4f9e-40c3-b4a8-30ac4101829e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Delete snapshot completed successfully.
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-9919ae3d-c15b-45c9-9d0a-6ce1d0886576 req-3f80ddf4-562c-4f0d-a19a-c8b1eac84a05 tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-ea413cea-38ce-4570-8d1f-de4128b406aa-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Acquiring lock "cinder-56a5fec8-123e-427d-b55b-6ca70d04ca19-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-56a5fec8-123e-427d-b55b-6ca70d04ca19-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Acquiring lock "cinder-quobyte-56a5fec8-123e-427d-b55b-6ca70d04ca19" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-quobyte-56a5fec8-123e-427d-b55b-6ca70d04ca19" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2109ad-71c9-4f09-b462-931f9d4e998a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:11 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19
Apr 09 10:42:11 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-bed47bda-9e1b-447d-ad5c-527fdc0e19d3-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-bed47bda-9e1b-447d-ad5c-527fdc0e19d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-quobyte-bed47bda-9e1b-447d-ad5c-527fdc0e19d3" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-bed47bda-9e1b-447d-ad5c-527fdc0e19d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d64af17-fbf4-4efd-8053-d18789ed146f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:11 devstack sudo[86026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3
Apr 09 10:42:11 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:11 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19" returned: 0 in 0.607s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:11 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19
Apr 09 10:42:11 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "cinder-a3477d09-10c2-48b2-8dd1-ad4f1181e45e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-a3477d09-10c2-48b2-8dd1-ad4f1181e45e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "cinder-quobyte-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-quobyte-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4310b0-3312-4e54-b088-aebc54632452]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:12 devstack sudo[86052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e
Apr 09 10:42:12 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:12 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56a5fec8-123e-427d-b55b-6ca70d04ca19" returned: 0 in 0.463s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-quobyte-56a5fec8-123e-427d-b55b-6ca70d04ca19" released by "delete_volume" :: held 1.094s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Created reservations ['691cc3eb-1bb7-48ce-bf30-659101069f8a', '002f1138-9ea6-4359-baca-ac487fb1e41f', 'b4649e92-9522-43a8-bb7b-86a4d0a6325a', '9fe05e45-6e06-41a0-8703-1adfdc99b1d5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:12 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3" returned: 0 in 0.711s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:12 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3
Apr 09 10:42:12 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:12 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:12 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:12 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" returned: 0 in 0.525s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:12 devstack sudo[86066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e
Apr 09 10:42:12 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:12 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bed47bda-9e1b-447d-ad5c-527fdc0e19d3" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-bed47bda-9e1b-447d-ad5c-527fdc0e19d3" released by "delete_volume" :: held 1.161s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Created reservations ['652554d0-fe39-4696-b081-501e27607b8c', 'e6c1528e-ef87-4d25-b6f5-ed7fe190387f', 'a16a6dab-7df7-4dd6-9071-f12165231e69', '2a9cc93a-3b47-42c1-80ab-2bea0c0d6e9a'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:12 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.458s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Deleted volume successfully.
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fd8adac7-3ac4-489e-bd98-38a3c7d98b2a tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-56a5fec8-123e-427d-b55b-6ca70d04ca19-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:12 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:12 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:13 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-quobyte-a3477d09-10c2-48b2-8dd1-ad4f1181e45e" released by "delete_volume" :: held 1.051s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.quota [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Created reservations ['a25ea971-54b2-4391-aeb4-7ec1f8353e6d', 'd349a8fa-3b84-44ac-a3cd-d31d0bd846ce', '8a297991-e2e9-473a-b200-c1f1af780cc7', '8d837055-af44-406b-8e47-6340cb8a7e00'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:13 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:13 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:13 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.494s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Deleted volume successfully.
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cb4f9ffe-d40f-43b1-b6f2-c430b4244c8b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-bed47bda-9e1b-447d-ad5c-527fdc0e19d3-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Flow 'volume_create_manager' (52a66c75-3fe5-4e7a-975d-0b03ffdf3447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0e8e74-0c56-45af-b804-e74beb783add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0e8e74-0c56-45af-b804-e74beb783add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1515602543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b003b04a-55a3-49da-8aa4-c222e3ec44c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e04a6c3af4932a52912581b12698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:14Z,use_quota=True,user_id='23f1ce6fce9d4e9fa4399a0de95d3ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deef152c-6985-41d2-aeb3-003737468e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deef152c-6985-41d2-aeb3-003737468e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b63ae2-31ea-430d-b256-b357b9d98e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b63ae2-31ea-430d-b256-b357b9d98e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b003b04a-55a3-49da-8aa4-c222e3ec44c1', 'volume_name': 'volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c7f8a6-7f93-4c61-9073-2ea9e2221935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c7f8a6-7f93-4c61-9073-2ea9e2221935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f37ff53-7893-404a-b1b9-d3fddfb2c4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:13 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Volume b003b04a-55a3-49da-8aa4-c222e3ec44c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1', 'volume_size': 1}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1515602543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b003b04a-55a3-49da-8aa4-c222e3ec44c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e04a6c3af4932a52912581b12698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:14Z,use_quota=True,user_id='23f1ce6fce9d4e9fa4399a0de95d3ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Creating volume b003b04a-55a3-49da-8aa4-c222e3ec44c1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:13 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:13 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.440s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.manager [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Deleted volume successfully.
Apr 09 10:42:13 devstack sudo[86079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 1073741824
Apr 09 10:42:13 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-bc8e69f6-d139-40de-802e-677c8ea554f7 req-11f4417b-ba33-4a83-9dfb-a3e76096189d tempest-VolumesSnapshotsTestJSON-409739579 None] Lock "cinder-a3477d09-10c2-48b2-8dd1-ad4f1181e45e-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (a4f82555-aafa-455f-b46c-989baa8b3c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1aebfd-5ffb-4138-b271-8f89e20f1589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1aebfd-5ffb-4138-b271-8f89e20f1589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1534300046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4a4438-01eb-40a5-a0b3-67ddb9932321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:14Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8efa2c-8a59-4822-8f45-0bd4a1285d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8efa2c-8a59-4822-8f45-0bd4a1285d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1229214a-2642-458c-b8cc-678f57c55452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1229214a-2642-458c-b8cc-678f57c55452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4a4438-01eb-40a5-a0b3-67ddb9932321', 'volume_name': 'volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc4ae9b-448c-46f4-977a-9dd3af72c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc4ae9b-448c-46f4-977a-9dd3af72c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c6094b-6958-4d93-9d9a-7427d0be6526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:14 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Volume 0c4a4438-01eb-40a5-a0b3-67ddb9932321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321', 'volume_size': 1}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:14 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 1073741824" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:14 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1
Apr 09 10:42:14 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:14 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1534300046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4a4438-01eb-40a5-a0b3-67ddb9932321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:14Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Creating volume 0c4a4438-01eb-40a5-a0b3-67ddb9932321 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:14 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f37ff53-7893-404a-b1b9-d3fddfb2c4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:14 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 1073741824
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948a1ac4-af2e-437a-854f-fd20fdbe6b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:14 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:14 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Volume volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 (b003b04a-55a3-49da-8aa4-c222e3ec44c1): created successfully
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948a1ac4-af2e-437a-854f-fd20fdbe6b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Flow 'volume_create_manager' (52a66c75-3fe5-4e7a-975d-0b03ffdf3447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:14 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-113d0c43-c3ab-44a2-9a71-6a15c654d29f tempest-VolumesTransfersV357Test-1176253983 None] Created volume successfully.
Apr 09 10:42:15 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 1073741824" returned: 0 in 0.577s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:15 devstack sudo[86093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321
Apr 09 10:42:15 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:15 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321" returned: 0 in 0.543s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c6094b-6958-4d93-9d9a-7427d0be6526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745ba106-0a6b-44d9-8506-b89384d5a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:15 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Volume volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 (0c4a4438-01eb-40a5-a0b3-67ddb9932321): created successfully
Apr 09 10:42:15 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745ba106-0a6b-44d9-8506-b89384d5a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (a4f82555-aafa-455f-b46c-989baa8b3c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Acquiring lock "cinder-b003b04a-55a3-49da-8aa4-c222e3ec44c1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b12dc701-ccc4-45b8-babe-fea155a6217f tempest-VolumesActionsTest-1141904284 None] Created volume successfully.
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-b003b04a-55a3-49da-8aa4-c222e3ec44c1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Acquiring lock "cinder-quobyte-b003b04a-55a3-49da-8aa4-c222e3ec44c1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-quobyte-b003b04a-55a3-49da-8aa4-c222e3ec44c1" acquired by "delete_volume" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc4b2c6-00b0-4c16-9a77-42129f69a9e6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:16 devstack sudo[86096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1
Apr 09 10:42:16 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-0c4a4438-01eb-40a5-a0b3-67ddb9932321-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Lock "cinder-0c4a4438-01eb-40a5-a0b3-67ddb9932321-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-quobyte-0c4a4438-01eb-40a5-a0b3-67ddb9932321" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-0c4a4438-01eb-40a5-a0b3-67ddb9932321" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b36ae05-7462-49cf-be9a-f6618a6fe65e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:16 devstack sudo[86098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321
Apr 09 10:42:16 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:16 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1" returned: 0 in 0.606s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:16 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1
Apr 09 10:42:16 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0cecbd92-8645-4937-882f-a4e2bbeba609 tempest-GroupSnapshotsTest-927558645 None] Group tempest-GroupSnapshotsTest-Group-1776438686: creating
Apr 09 10:42:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0cecbd92-8645-4937-882f-a4e2bbeba609 tempest-GroupSnapshotsTest-927558645 None] Group tempest-GroupSnapshotsTest-Group-1776438686: created successfully
Apr 09 10:42:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0cecbd92-8645-4937-882f-a4e2bbeba609 tempest-GroupSnapshotsTest-927558645 None] Create group completed successfully.
Apr 09 10:42:16 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321" returned: 0 in 0.594s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:17 devstack sudo[86108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321
Apr 09 10:42:17 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:17 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b003b04a-55a3-49da-8aa4-c222e3ec44c1" returned: 0 in 0.458s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-quobyte-b003b04a-55a3-49da-8aa4-c222e3ec44c1" released by "delete_volume" :: held 1.087s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Created reservations ['8314c2aa-1b43-4577-91a5-147449cb2621', 'ce730cff-7fc7-4e93-b5a9-33389db3655f', 'fab9a5e9-b7e9-4879-a16f-0a523b5efa68', 'f926fd80-0a9e-4c32-8773-0a7d33c11c6a'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:17 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:17 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:17 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0c4a4438-01eb-40a5-a0b3-67ddb9932321" returned: 0 in 0.449s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-0c4a4438-01eb-40a5-a0b3-67ddb9932321" released by "delete_volume" :: held 1.066s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Created reservations ['df6a21fa-8e5a-4115-903e-8f3bc28f88fd', 'c5c8cdf2-68f7-473f-a226-f30d3708ffe4', '7f35774a-7f2f-4e1c-861e-76caf56db472', 'e036155e-a2df-40e5-86be-5d3643421f28'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:17 devstack sudo[86114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:17 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:17 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Deleted volume successfully.
Apr 09 10:42:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3932f55d-22de-49d4-ac62-072d46620b4b tempest-VolumesTransfersV357Test-1336142038 None] Lock "cinder-b003b04a-55a3-49da-8aa4-c222e3ec44c1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:18 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:18 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Deleted volume successfully.
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-21e07a81-0439-48a3-94d4-ccfbc984da2c tempest-VolumesActionsTest-1998967844 None] Lock "cinder-0c4a4438-01eb-40a5-a0b3-67ddb9932321-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (229f5738-1d33-45e5-bead-346d5d7ee794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9bf652-0a79-41d0-bc76-9f26fc83cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9bf652-0a79-41d0-bc76-9f26fc83cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26044160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=239256f4-b2c8-4d8c-9ef9-eb54fd3b694f,host='devstack@QuobyteHD#QuobyteHD',id=1ca2a166-ea27-45db-92bc-5ed4855c62dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:18Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39184f04-8f49-435e-8e60-dd53f6bcf980),volume_type_id=39184f04-8f49-435e-8e60-dd53f6bcf980)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d5724b-3dd7-425d-a2f0-016f03fc5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d5724b-3dd7-425d-a2f0-016f03fc5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3d0e19-46e4-4a8b-9af7-a1f81f7bc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3d0e19-46e4-4a8b-9af7-a1f81f7bc314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca2a166-ea27-45db-92bc-5ed4855c62dd', 'volume_name': 'volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febd61c4-e620-405f-a07e-48a92eda3eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febd61c4-e620-405f-a07e-48a92eda3eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d5385b-06f7-4919-81fc-83a72304c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Volume 1ca2a166-ea27-45db-92bc-5ed4855c62dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd', 'volume_size': 1}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=239256f4-b2c8-4d8c-9ef9-eb54fd3b694f,created_at=2026-04-09T08:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26044160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=239256f4-b2c8-4d8c-9ef9-eb54fd3b694f,host='devstack@QuobyteHD#QuobyteHD',id=1ca2a166-ea27-45db-92bc-5ed4855c62dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:18Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39184f04-8f49-435e-8e60-dd53f6bcf980),volume_type_id=39184f04-8f49-435e-8e60-dd53f6bcf980)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Creating volume 1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:18 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:18 devstack sudo[86119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd 1073741824
Apr 09 10:42:18 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (c970d673-9d78-45ec-b897-72b53a735768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:18 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01deaee-7943-4af4-880b-dbb45c735335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd 1073741824" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01deaee-7943-4af4-880b-dbb45c735335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314043734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd731f59-b244-4559-8a86-f51845075b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:19Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95900d91-7c48-4c85-9ddd-c186787a4fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95900d91-7c48-4c85-9ddd-c186787a4fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33776cf-1e76-4031-abea-e6656f69f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33776cf-1e76-4031-abea-e6656f69f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd731f59-b244-4559-8a86-f51845075b28', 'volume_name': 'volume-bd731f59-b244-4559-8a86-f51845075b28', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf2c51-aa61-4aa8-86b4-b83aba9c518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf2c51-aa61-4aa8-86b4-b83aba9c518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50627a59-32bd-4dc8-914e-b068f66da013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:18 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Volume bd731f59-b244-4559-8a86-f51845075b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd731f59-b244-4559-8a86-f51845075b28', 'volume_size': 1}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:19 devstack sudo[86125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:19 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:19 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314043734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd731f59-b244-4559-8a86-f51845075b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:19Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Creating volume bd731f59-b244-4559-8a86-f51845075b28 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:19 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d5385b-06f7-4919-81fc-83a72304c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:19 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28 1073741824
Apr 09 10:42:19 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4393f707-1cdc-431c-a31c-01e55347dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:19 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Volume volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd (1ca2a166-ea27-45db-92bc-5ed4855c62dd): created successfully
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4393f707-1cdc-431c-a31c-01e55347dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (229f5738-1d33-45e5-bead-346d5d7ee794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:19 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-396fb88f-8fc8-4473-a100-f19f71342a38 tempest-GroupSnapshotsTest-927558645 None] Created volume successfully.
Apr 09 10:42:20 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28 1073741824" returned: 0 in 0.602s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:20 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28
Apr 09 10:42:20 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] GroupSnapshot d95bd07f-11db-496c-bebd-068a9332cf4a: creating.
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Group snapshot d95bd07f-11db-496c-bebd-068a9332cf4a: creating. {{(pid=82783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:20 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28" returned: 0 in 0.560s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.071s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50627a59-32bd-4dc8-914e-b068f66da013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd731f59-b244-4559-8a86-f51845075b28', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5024a1-3c1e-4e48-92ca-fd5f96ca94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Creating offline snapshot 3a5b6a4b-f22c-4a7d-be60-e54de2345703 of volume 1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:42:20 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Volume volume-bd731f59-b244-4559-8a86-f51845075b28 (bd731f59-b244-4559-8a86-f51845075b28): created successfully
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5024a1-3c1e-4e48-92ca-fd5f96ca94e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (c970d673-9d78-45ec-b897-72b53a735768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e36d35-bd3d-4bcb-bfc3-256c01f7d642]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5c9043d1-1461-423c-85e8-571c8896c484 tempest-VolumesActionsTest-1141904284 None] Created volume successfully.
Apr 09 10:42:20 devstack sudo[86137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:20 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-bd731f59-b244-4559-8a86-f51845075b28-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Lock "cinder-bd731f59-b244-4559-8a86-f51845075b28-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-quobyte-bd731f59-b244-4559-8a86-f51845075b28" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-bd731f59-b244-4559-8a86-f51845075b28" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6726a52-e2ce-4df4-8e2f-560d1f989131]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:21 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28
Apr 09 10:42:21 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:21 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.674s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:21 devstack sudo[86144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 1G
Apr 09 10:42:21 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:21 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28" returned: 0 in 0.611s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:21 devstack sudo[86149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28
Apr 09 10:42:21 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:22 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 1G" returned: 0 in 0.611s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:22 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703
Apr 09 10:42:22 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (9de57267-aaa7-43ae-a306-b30b78ca3cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55aab035-e9db-4f7f-95cd-211dd1841a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55aab035-e9db-4f7f-95cd-211dd1841a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1864926748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5f3d52-4183-4872-b1fa-b4e619cc0c30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:22Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bf912a-0e64-4ff1-9fb1-e687932d46d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bf912a-0e64-4ff1-9fb1-e687932d46d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efe0d9e-5f13-414e-ac5c-abff0f03fbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efe0d9e-5f13-414e-ac5c-abff0f03fbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5f3d52-4183-4872-b1fa-b4e619cc0c30', 'volume_name': 'volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9ae4bf-5a95-4fca-aac1-7ff68853ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9ae4bf-5a95-4fca-aac1-7ff68853ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d59527-1e5c-4e1f-9f5e-26551867c140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:22 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Volume 2e5f3d52-4183-4872-b1fa-b4e619cc0c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30', 'volume_size': 1}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:22 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bd731f59-b244-4559-8a86-f51845075b28" returned: 0 in 0.575s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-bd731f59-b244-4559-8a86-f51845075b28" released by "delete_volume" :: held 1.222s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Created reservations ['6ac819a8-65ed-4317-aadf-f83627c36544', 'da30dd50-87eb-45c7-b356-ad9501a029ba', '3494b346-4e7c-4930-b64f-c6a21b90af06', '02b50fd0-b432-44bd-bf68-6e074164a644'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:22 devstack sudo[86158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:22 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:22 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703" returned: 0 in 0.572s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:22 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:42:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:22 devstack sudo[86163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703
Apr 09 10:42:22 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:23 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:23 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Deleted volume successfully.
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-701ae791-9188-42d8-8103-915b4b88842d tempest-VolumesActionsTest-1998967844 None] Lock "cinder-bd731f59-b244-4559-8a86-f51845075b28-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:23 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703" returned: 0 in 0.461s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:23 devstack sudo[86167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info
Apr 09 10:42:23 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:23 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info" returned: 0 in 0.445s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:23 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:23 devstack sudo[86170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info
Apr 09 10:42:23 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (46bb9fdf-f4f4-4ef6-a652-8957fdef8c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b09383-d165-4c6a-93e2-d1f65911aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b09383-d165-4c6a-93e2-d1f65911aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1972263686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf59b68-4aec-43b6-9925-45142c13a89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:24Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f91af5-6206-4c9b-b9ff-de7a07180c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f91af5-6206-4c9b-b9ff-de7a07180c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e095e970-2e75-42f0-94ae-080a08c3d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e095e970-2e75-42f0-94ae-080a08c3d520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf59b68-4aec-43b6-9925-45142c13a89f', 'volume_name': 'volume-3cf59b68-4aec-43b6-9925-45142c13a89f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aca092d-b7f5-4781-a01e-558d999e9413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aca092d-b7f5-4781-a01e-558d999e9413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4f6e0e-1f48-4933-803d-4d265d620faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:23 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Volume 3cf59b68-4aec-43b6-9925-45142c13a89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf59b68-4aec-43b6-9925-45142c13a89f', 'volume_size': 1}
Apr 09 10:42:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:24 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.info" returned: 0 in 0.471s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1864926748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5f3d52-4183-4872-b1fa-b4e619cc0c30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:22Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Creating volume 2e5f3d52-4183-4872-b1fa-b4e619cc0c30 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:24 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:24 devstack sudo[86173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 1073741824
Apr 09 10:42:24 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-9be72f07-e868-4075-b261-2ffb13645996 tempest-GroupSnapshotsTest-927558645 None] group_snapshot d95bd07f-11db-496c-bebd-068a9332cf4a: created successfully
Apr 09 10:42:24 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 1073741824" returned: 0 in 0.607s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:24 devstack sudo[86178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30
Apr 09 10:42:24 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:25 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1972263686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf59b68-4aec-43b6-9925-45142c13a89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:24Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Creating volume 3cf59b68-4aec-43b6-9925-45142c13a89f {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:25 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d59527-1e5c-4e1f-9f5e-26551867c140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf9ff89-9d84-4236-b5b2-dcc9e8069402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:25 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f 1073741824
Apr 09 10:42:25 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:25 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Volume volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 (2e5f3d52-4183-4872-b1fa-b4e619cc0c30): created successfully
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf9ff89-9d84-4236-b5b2-dcc9e8069402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (9de57267-aaa7-43ae-a306-b30b78ca3cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-243a1814-b7ad-4b51-9cc4-bc5f06c4b312 tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (fa5278bc-5054-4c1e-9829-24229cedac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3d810c-1d20-4502-a29e-64cd2f4bb684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:25 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3d810c-1d20-4502-a29e-64cd2f4bb684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-771519835',display_name='tempest-VolumesGetTest-Volume-1755198845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39158d8-9555-4834-be83-5609d71324f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:26Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51ff724-c300-4441-bd83-f3642c939c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51ff724-c300-4441-bd83-f3642c939c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c7350d-488d-445c-baac-f8c993b2d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c7350d-488d-445c-baac-f8c993b2d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39158d8-9555-4834-be83-5609d71324f6', 'volume_name': 'volume-c39158d8-9555-4834-be83-5609d71324f6', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7018ff38-8cd6-4949-a559-e15240154304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7018ff38-8cd6-4949-a559-e15240154304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a49b92-4552-46cc-95ef-50ddf285ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:25 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Volume c39158d8-9555-4834-be83-5609d71324f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39158d8-9555-4834-be83-5609d71324f6', 'volume_size': 1}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f 1073741824" returned: 0 in 0.750s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:25 devstack sudo[86188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f
Apr 09 10:42:25 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:26 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f" returned: 0 in 0.453s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.562s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-3a5b6a4b-f22c-4a7d-be60-e54de2345703-f372260c-8059-4a17-bfcf-d601d6c03147" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4f6e0e-1f48-4933-803d-4d265d620faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf59b68-4aec-43b6-9925-45142c13a89f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecf2560-8ecf-4849-81dc-228be64e29e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-3a5b6a4b-f22c-4a7d-be60-e54de2345703-f372260c-8059-4a17-bfcf-d601d6c03147" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Creating volume f372260c-8059-4a17-bfcf-d601d6c03147 from snapshot 3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-f372260c-8059-4a17-bfcf-d601d6c03147" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:26 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Volume volume-3cf59b68-4aec-43b6-9925-45142c13a89f (3cf59b68-4aec-43b6-9925-45142c13a89f): created successfully
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecf2560-8ecf-4849-81dc-228be64e29e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (46bb9fdf-f4f4-4ef6-a652-8957fdef8c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-f372260c-8059-4a17-bfcf-d601d6c03147" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] snapshot: 3a5b6a4b-f22c-4a7d-be60-e54de2345703, volume: f372260c-8059-4a17-bfcf-d601d6c03147,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:42:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3c7ad2b1-efc8-4a9d-b519-ed79964868a8 tempest-VolumesActionsTest-1141904284 None] Created volume successfully.
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac22e44-dadf-44b2-83a0-ca8a3b21c9ff]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:26 devstack sudo[86191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703
Apr 09 10:42:26 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-3cf59b68-4aec-43b6-9925-45142c13a89f-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-3cf59b68-4aec-43b6-9925-45142c13a89f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:27 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703" returned: 0 in 0.609s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f241e22-91aa-428b-bfa4-fe1957e6fe4b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Acquiring lock "cinder-quobyte-3cf59b68-4aec-43b6-9925-45142c13a89f" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-3cf59b68-4aec-43b6-9925-45142c13a89f" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc62d4-eb07-4579-a14a-7feba356b4c4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:27 devstack sudo[86196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:27 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:27 devstack sudo[86197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f
Apr 09 10:42:27 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:27 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.543s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:27 devstack sudo[86206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147
Apr 09 10:42:27 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:27 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f" returned: 0 in 0.534s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:27 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f
Apr 09 10:42:27 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:28 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3cf59b68-4aec-43b6-9925-45142c13a89f" returned: 0 in 0.646s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-quobyte-3cf59b68-4aec-43b6-9925-45142c13a89f" released by "delete_volume" :: held 1.209s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=133,cinder:UPDATE=163,cinder:INSERT=48,cinder:DELETE=14 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Created reservations ['4f31d5f5-f110-485b-b77c-2ac8819fe260', '29d43d9a-7a7c-4c2d-9526-0c01c413e67c', '0ebd8a29-e24a-4208-9b4e-cc09efac03d8', '4e3449b5-7e95-4ddb-a821-3a9ecca12c67'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:28 devstack sudo[86234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:28 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:29 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 1.220s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:29 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Deleted volume successfully.
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:UPDATE=194,cinder:SELECT=150,cinder:DELETE=17,cinder:INSERT=34 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab063ad9-7292-481d-a03c-2b81d5c2312b tempest-VolumesActionsTest-1998967844 None] Lock "cinder-3cf59b68-4aec-43b6-9925-45142c13a89f-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (ecb1419f-ebc2-4126-af21-1c4704fd04af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e55352-810a-4b0d-8f2c-fe2a693f11d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e55352-810a-4b0d-8f2c-fe2a693f11d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578610177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192e8467-1fe0-4354-8e9e-98f461d5c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:30Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148db6ad-44f1-43e5-97d7-8e04fbf6dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148db6ad-44f1-43e5-97d7-8e04fbf6dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61496f84-ba99-4861-8d63-bd6bc531209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61496f84-ba99-4861-8d63-bd6bc531209c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192e8467-1fe0-4354-8e9e-98f461d5c5ff', 'volume_name': 'volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe99b6e-9cab-4659-85e4-d552cc380d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe99b6e-9cab-4659-85e4-d552cc380d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21319e0d-b58a-4de5-91dc-ca24cc1efdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:30 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Volume 192e8467-1fe0-4354-8e9e-98f461d5c5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff', 'volume_size': 1}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:30 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147" returned: 0 in 2.474s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6656f076-1976-4ac1-8803-f3d13a2f500a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:30 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:30 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:30 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.670s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:42:30 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Converted 1024.00 MB image at 413.84 MB/s
Apr 09 10:42:30 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:42:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:30 devstack sudo[86243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147
Apr 09 10:42:30 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:31 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-f372260c-8059-4a17-bfcf-d601d6c03147" released by "_copy_volume_from_snapshot" :: held 4.840s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-3a5b6a4b-f22c-4a7d-be60-e54de2345703-f372260c-8059-4a17-bfcf-d601d6c03147" released by "_create_volume_from_snapshot" :: held 4.874s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.894s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.375s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-771519835',display_name='tempest-VolumesGetTest-Volume-1755198845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39158d8-9555-4834-be83-5609d71324f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:26Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Creating volume c39158d8-9555-4834-be83-5609d71324f6 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:31 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:31 devstack sudo[86246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6 1073741824
Apr 09 10:42:31 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-919fdc82-a85d-4402-8d0d-1558d4f366df tempest-GroupSnapshotsTest-927558645 None] Create group from source-snapshot-d95bd07f-11db-496c-bebd-068a9332cf4a completed successfully.
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-f372260c-8059-4a17-bfcf-d601d6c03147" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-f372260c-8059-4a17-bfcf-d601d6c03147" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16d78f-33d6-4925-9467-29dcabc5d62f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:31 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147
Apr 09 10:42:31 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:31 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6 1073741824" returned: 0 in 0.646s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:31 devstack sudo[86257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6
Apr 09 10:42:31 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:32 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147" returned: 0 in 0.580s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:32 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147
Apr 09 10:42:32 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:32 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578610177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192e8467-1fe0-4354-8e9e-98f461d5c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865716f257c45148cb0cdba7b997d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:30Z,use_quota=True,user_id='6e5a1655270b446eb408f365aae1c312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Creating volume 192e8467-1fe0-4354-8e9e-98f461d5c5ff {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:32 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a49b92-4552-46cc-95ef-50ddf285ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39158d8-9555-4834-be83-5609d71324f6', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea58c5de-0e61-4d0c-a7a7-ff3070939847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:32 devstack sudo[86270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff 1073741824
Apr 09 10:42:32 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Volume volume-c39158d8-9555-4834-be83-5609d71324f6 (c39158d8-9555-4834-be83-5609d71324f6): created successfully
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea58c5de-0e61-4d0c-a7a7-ff3070939847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (fa5278bc-5054-4c1e-9829-24229cedac4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a1c3f76c-2322-40f4-b6c8-5738afb1712f tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:42:32 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f372260c-8059-4a17-bfcf-d601d6c03147" returned: 0 in 0.463s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-f372260c-8059-4a17-bfcf-d601d6c03147" released by "delete_volume" :: held 1.065s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['605e4202-ce13-4fe8-a19b-85f1d38666b8'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:32 devstack cinder-volume[82783]: WARNING cinder.quota [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1446585810 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1446585810, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:42:32 devstack cinder-volume[82783]: WARNING cinder.quota [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1446585810 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1446585810, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['7cdab0d7-092d-4e7d-b352-28e33f41d9fc', '28635ff2-955a-4c6a-a8a5-fb41575f3e5b', 'adc9055a-f752-469c-819e-17aa9fac9293', '35b9b511-7ded-4406-a497-002183ee627a'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:32 devstack sudo[86277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:32 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:32 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff 1073741824" returned: 0 in 0.548s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:33 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff
Apr 09 10:42:33 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:33 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.444s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a1879349-57fc-4aa1-929c-ee2c5087e380 tempest-GroupSnapshotsTest-927558645 None] Delete group completed successfully.
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-c39158d8-9555-4834-be83-5609d71324f6-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Lock "cinder-c39158d8-9555-4834-be83-5609d71324f6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:33 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff" returned: 0 in 0.491s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21319e0d-b58a-4de5-91dc-ca24cc1efdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7374a6-db0c-40a7-8fe2-38db8febfa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Volume volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff (192e8467-1fe0-4354-8e9e-98f461d5c5ff): created successfully
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7374a6-db0c-40a7-8fe2-38db8febfa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Flow 'volume_create_manager' (ecb1419f-ebc2-4126-af21-1c4704fd04af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-c39158d8-9555-4834-be83-5609d71324f6" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f7514d83-cbe4-45c5-bfcc-7580ec105d81 tempest-VolumesActionsTest-1141904284 None] Created volume successfully.
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-c39158d8-9555-4834-be83-5609d71324f6" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f854d8-5c2d-4522-b50a-5c0baa0f396e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:33 devstack sudo[86283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6
Apr 09 10:42:33 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] group_snapshot d95bd07f-11db-496c-bebd-068a9332cf4a: deleting
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] group_snapshot d95bd07f-11db-496c-bebd-068a9332cf4a: deleting {{(pid=82783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-1ca2a166-ea27-45db-92bc-5ed4855c62dd" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-1ca2a166-ea27-45db-92bc-5ed4855c62dd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-3a5b6a4b-f22c-4a7d-be60-e54de2345703" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-3a5b6a4b-f22c-4a7d-be60-e54de2345703" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Deleting offline snapshot 3a5b6a4b-f22c-4a7d-be60-e54de2345703 of volume 1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] snapshot_file for this snap is: volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f4f66-917a-49ba-bcc8-aee00a04ed95]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:34 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:34 devstack sudo[86288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703
Apr 09 10:42:34 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:34 devstack sudo[86289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6
Apr 09 10:42:34 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:34 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c39158d8-9555-4834-be83-5609d71324f6" returned: 0 in 0.494s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-c39158d8-9555-4834-be83-5609d71324f6" released by "delete_volume" :: held 0.997s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:34 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703" returned: 0 in 0.606s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059436a-48e0-4d7f-b9a7-8c146dad43cb]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Created reservations ['5bda4b25-3463-4702-87cf-e08d5beb9766', '718a97ac-e1df-4316-bfab-55ebdcb77f11', '17f972d2-d7c0-4e77-9209-c811fa41b627', 'cd7b4c93-9f80-4b91-8339-8f97bc0466bd'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:34 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:34 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "cinder-192e8467-1fe0-4354-8e9e-98f461d5c5ff-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Lock "cinder-192e8467-1fe0-4354-8e9e-98f461d5c5ff-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:34 devstack sudo[86296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:34 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "cinder-quobyte-192e8467-1fe0-4354-8e9e-98f461d5c5ff" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Lock "cinder-quobyte-192e8467-1fe0-4354-8e9e-98f461d5c5ff" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ad032b-1238-4709-81eb-2d78cc86b894]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:34 devstack sudo[86300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff
Apr 09 10:42:34 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:35 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.441s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-59ed5c06-9e3b-4882-9eed-4bc6d6a368d1 tempest-VolumesGetTest-976428399 None] Lock "cinder-c39158d8-9555-4834-be83-5609d71324f6-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:35 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.542s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:35 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703
Apr 09 10:42:35 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:35 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff" returned: 0 in 0.501s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:35 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff
Apr 09 10:42:35 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-2e5f3d52-4183-4872-b1fa-b4e619cc0c30-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Lock "cinder-2e5f3d52-4183-4872-b1fa-b4e619cc0c30-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:35 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703" returned: 0 in 0.560s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:35 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703
Apr 09 10:42:35 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:35 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-2e5f3d52-4183-4872-b1fa-b4e619cc0c30" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-192e8467-1fe0-4354-8e9e-98f461d5c5ff" returned: 0 in 0.507s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Lock "cinder-quobyte-192e8467-1fe0-4354-8e9e-98f461d5c5ff" released by "delete_volume" :: held 1.028s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-2e5f3d52-4183-4872-b1fa-b4e619cc0c30" acquired by "delete_volume" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a33a42-7c2f-4094-adca-72cc4f913152]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Created reservations ['26b7ca51-ff29-47bc-b384-041de5a237b6', '8278d2e2-b82b-467c-868a-251862403122', 'f82654e0-bbcb-47e9-a054-9e970060e8cb', 'd8576e0f-1942-49d7-b65e-5d942b44f0e6'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:35 devstack sudo[86319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30
Apr 09 10:42:35 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:35 devstack sudo[86321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:35 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:36 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd.3a5b6a4b-f22c-4a7d-be60-e54de2345703" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-3a5b6a4b-f22c-4a7d-be60-e54de2345703" released by "_delete_snapshot" :: held 2.299s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-1ca2a166-ea27-45db-92bc-5ed4855c62dd" released by "delete_snapshot" :: held 2.319s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:36 devstack cinder-volume[82783]: WARNING cinder.quota [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1446585810 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1446585810, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['8aed2bbc-2500-4816-b576-daf7f7686959', 'a8147119-a9af-4a92-963e-81bc150d78da', 'a5d5ab85-2dc9-4fad-93da-746d02a2d7f2', '3feebba0-9000-46ea-8746-8f171cc15e73'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c030aa4a-0854-4169-bb67-74fa220d62e1 tempest-GroupSnapshotsTest-927558645 None] group_snapshot d95bd07f-11db-496c-bebd-068a9332cf4a: deleted successfully
Apr 09 10:42:36 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30" returned: 0 in 0.588s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:36 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30
Apr 09 10:42:36 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:36 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.583s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Deleted volume successfully.
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17934729-22b4-4a9c-9489-147d898fd098 tempest-VolumesActionsTest-1141904284 None] Lock "cinder-192e8467-1fe0-4354-8e9e-98f461d5c5ff-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:36 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2e5f3d52-4183-4872-b1fa-b4e619cc0c30" returned: 0 in 0.497s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-2e5f3d52-4183-4872-b1fa-b4e619cc0c30" released by "delete_volume" :: held 1.108s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Created reservations ['d788135a-d758-4873-b9e4-dce5b8f554ce', '7080e128-ae3a-4a23-a536-b3d42b4d78ef', '6ab64fd9-ac56-436d-8e0b-00a0486db91a', '0b4d9a79-bfc4-46d0-bd0e-f5565a75bd5d'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:37 devstack sudo[86331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:37 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-1ca2a166-ea27-45db-92bc-5ed4855c62dd" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-1ca2a166-ea27-45db-92bc-5ed4855c62dd" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd5fd9d-0262-4aed-a376-4c78cc8bebf6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:37 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:37 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:37 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.589s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b6428bfd-f619-4fad-bc29-72e970b91b7d tempest-VolumesGetTest-976428399 None] Lock "cinder-2e5f3d52-4183-4872-b1fa-b4e619cc0c30-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:37 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.634s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:37 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd
Apr 09 10:42:37 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (1dc86e55-8fe0-439d-8c2b-a0374f850fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdf61e3-8d3c-429b-b400-77533d91b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdf61e3-8d3c-429b-b400-77533d91b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-907162800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56678fd3-ce1f-44bd-bd85-6ee5fc336384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:38Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7ebc24-5884-4a4f-a081-922568b5706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7ebc24-5884-4a4f-a081-922568b5706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52edfcb-304c-44e9-88c1-93b89f8fe5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52edfcb-304c-44e9-88c1-93b89f8fe5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'volume_name': 'volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaed1fb-ff4e-4b02-a951-f3e684f5222e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaed1fb-ff4e-4b02-a951-f3e684f5222e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93950adf-a88b-4cdd-87c1-a934e2a57e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Volume 56678fd3-ce1f-44bd-bd85-6ee5fc336384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'volume_size': 1}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-907162800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56678fd3-ce1f-44bd-bd85-6ee5fc336384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:38Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Creating volume 56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:38 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:38 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 1073741824
Apr 09 10:42:38 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:38 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1ca2a166-ea27-45db-92bc-5ed4855c62dd" returned: 0 in 0.723s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-1ca2a166-ea27-45db-92bc-5ed4855c62dd" released by "delete_volume" :: held 1.402s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['026a331b-4715-446d-b15e-b9d755e0df0b'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:38 devstack cinder-volume[82783]: WARNING cinder.db.sqlalchemy.api [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1446585810']
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['1e7b7f32-72e2-4671-b171-f78dbff5ede4', '2922030d-7430-414b-a0bf-9307e71f45ea', '7a1655d5-3a83-44b9-8f29-3e44d2f0ddca', 'f91e975d-e4af-4870-b799-69ed49d235c4'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:38 devstack sudo[86365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:38 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:39 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 1073741824" returned: 0 in 0.733s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:39 devstack sudo[86367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:42:39 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:39 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.555s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:39 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a68cb6f7-52ff-4008-84a6-2b57a59df6e7 tempest-GroupSnapshotsTest-927558645 None] Delete group completed successfully.
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:39 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:39 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:39 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.574s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93950adf-a88b-4cdd-87c1-a934e2a57e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73540fae-b23f-4db1-a0f6-3ad11f748904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:39 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Volume volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 (56678fd3-ce1f-44bd-bd85-6ee5fc336384): created successfully
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73540fae-b23f-4db1-a0f6-3ad11f748904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (1dc86e55-8fe0-439d-8c2b-a0374f850fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:39 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4d62f875-2b25-4488-ba74-809d6c7bef45 tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:42:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0e292087-9c30-4904-b81f-48ca459863bf tempest-GroupSnapshotsTest-927558645 None] Group tempest-GroupSnapshotsTest-Group-263057259: creating
Apr 09 10:42:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0e292087-9c30-4904-b81f-48ca459863bf tempest-GroupSnapshotsTest-927558645 None] Group tempest-GroupSnapshotsTest-Group-263057259: created successfully
Apr 09 10:42:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0e292087-9c30-4904-b81f-48ca459863bf tempest-GroupSnapshotsTest-927558645 None] Create group completed successfully.
Apr 09 10:42:40 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.609s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (de6601ed-de69-477d-886d-9a83dff9734b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c372efd1-e7a1-4662-9d6d-a87e6de57adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c372efd1-e7a1-4662-9d6d-a87e6de57adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-682905927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce4e83e-5940-4f22-a770-408eb59aaaa9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=56678fd3-ce1f-44bd-bd85-6ee5fc336384,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:41Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43263d18-c5fc-4341-8d14-adafce1f39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43263d18-c5fc-4341-8d14-adafce1f39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f570a0d0-44fc-4320-b653-2a643732e9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f570a0d0-44fc-4320-b653-2a643732e9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0ce4e83e-5940-4f22-a770-408eb59aaaa9', 'volume_name': 'volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9', 'volume_size': 1, 'source_volid': '56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a2a4ac-44d8-4724-a9b6-d666fdddf1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a2a4ac-44d8-4724-a9b6-d666fdddf1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2a1035-705d-4d9a-a827-5569eaaaf969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:40 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Volume 0ce4e83e-5940-4f22-a770-408eb59aaaa9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9', 'volume_size': 1, 'source_volid': '56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'source_volstatus': 'available'}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:40 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Cloning volume 56678fd3-ce1f-44bd-bd85-6ee5fc336384 to volume 0ce4e83e-5940-4f22-a770-408eb59aaaa9
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Creating offline snapshot 5488f206-5996-4a4c-8879-70c7c6165adc of volume 56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e25e93-9d1b-4692-816a-b0c199366513]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:40 devstack sudo[86392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:42:40 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:41 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.571s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:41 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc 1G
Apr 09 10:42:41 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (0bd5a0fc-7274-4957-a641-7eab91e9e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c652eaeb-fe04-4b00-998e-acb5b0e1e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c652eaeb-fe04-4b00-998e-acb5b0e1e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-471817233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=aef85ff6-9047-45b9-83ae-792bbc165694,host='devstack@QuobyteHD#QuobyteHD',id=e288c76a-e164-4ddf-99f9-1002bd757171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:41Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cf9bfa-11cf-48a5-81db-c88047257d1d),volume_type_id=97cf9bfa-11cf-48a5-81db-c88047257d1d)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e2ebe8-74f4-4aa0-a1e3-0a1252fdce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e2ebe8-74f4-4aa0-a1e3-0a1252fdce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796553f5-0762-4065-96db-ece7166a409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796553f5-0762-4065-96db-ece7166a409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e288c76a-e164-4ddf-99f9-1002bd757171', 'volume_name': 'volume-e288c76a-e164-4ddf-99f9-1002bd757171', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f3aeab-9cbb-4ca1-a249-6c633f57bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f3aeab-9cbb-4ca1-a249-6c633f57bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b37198-30e0-4942-a9ca-8f2983753fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:41 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Volume e288c76a-e164-4ddf-99f9-1002bd757171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e288c76a-e164-4ddf-99f9-1002bd757171', 'volume_size': 1}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:41 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc 1G" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:41 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc
Apr 09 10:42:41 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:42 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc" returned: 0 in 0.585s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:42 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc is being set with open permissions: ugo+rw
Apr 09 10:42:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:42 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc
Apr 09 10:42:42 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:42 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc" returned: 0 in 0.464s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:42 devstack sudo[86415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info
Apr 09 10:42:42 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:43 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:43 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info is being set with open permissions: ugo+rw
Apr 09 10:42:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:43 devstack sudo[86426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info
Apr 09 10:42:43 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:44 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.info" returned: 0 in 0.810s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-0ce4e83e-5940-4f22-a770-408eb59aaaa9" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-0ce4e83e-5940-4f22-a770-408eb59aaaa9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] snapshot: 5488f206-5996-4a4c-8879-70c7c6165adc, volume: 0ce4e83e-5940-4f22-a770-408eb59aaaa9,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacf1b86-1b10-4e86-9e2f-ae5da829e2f1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:44 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc
Apr 09 10:42:44 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:45 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc" returned: 0 in 1.156s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:42:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:42:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:42:45 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910154e-a976-4ce5-9e55-b5bb8c3c0b5f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:45 devstack sudo[86502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:42:45 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:46 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.792s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:46 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:42:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:46 devstack sudo[86509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9
Apr 09 10:42:46 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Flow 'volume_create_manager' (68a7e007-6cac-4d2a-8b4d-2d33310aa64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b363ee0b-8322-45bf-bb9c-bdbaedacebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b363ee0b-8322-45bf-bb9c-bdbaedacebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1187873590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1430cffc-8d2e-4a32-9067-428a5760e28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1059e68f9051404ba2c850eb8a18f981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:47Z,use_quota=True,user_id='e16ada11acf24785ab27d4e077baa993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa3f3ee-4fd2-449f-9512-b1b5fbd1cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa3f3ee-4fd2-449f-9512-b1b5fbd1cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a82dea7-b260-44f3-a7a6-f2397977a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a82dea7-b260-44f3-a7a6-f2397977a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1430cffc-8d2e-4a32-9067-428a5760e28e', 'volume_name': 'volume-1430cffc-8d2e-4a32-9067-428a5760e28e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d9defd-460a-4839-8e90-2aabeecddb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d9defd-460a-4839-8e90-2aabeecddb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35f4f88-ca63-496c-969d-602a7bd9dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:47 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Volume 1430cffc-8d2e-4a32-9067-428a5760e28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1430cffc-8d2e-4a32-9067-428a5760e28e', 'volume_size': 1}
Apr 09 10:42:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:50 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9" returned: 0 in 3.963s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824b871-bc08-41bd-af80-0a9313e7c3e4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:50 devstack sudo[86568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:42:50 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:51 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.902s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:42:51 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Converted 1024.00 MB image at 258.35 MB/s
Apr 09 10:42:51 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 is being set with open permissions: ugo+rw
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:51 devstack sudo[86584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9
Apr 09 10:42:51 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:51 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9" returned: 0 in 0.435s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-0ce4e83e-5940-4f22-a770-408eb59aaaa9" released by "_copy_volume_from_snapshot" :: held 7.398s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-5488f206-5996-4a4c-8879-70c7c6165adc" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-5488f206-5996-4a4c-8879-70c7c6165adc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Deleting offline snapshot 5488f206-5996-4a4c-8879-70c7c6165adc of volume 56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] snapshot_file for this snap is: volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8212ca3b-3800-4f4b-b6a0-4cd43abe8bde]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:51 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc
Apr 09 10:42:51 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:52 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc" returned: 0 in 0.558s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:42:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabdb3e1-1d59-4111-a614-1569f1255e67]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:52 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:42:52 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:52 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:52 devstack sudo[86604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc
Apr 09 10:42:52 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:53 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc" returned: 0 in 0.622s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:53 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc
Apr 09 10:42:53 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:53 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384.5488f206-5996-4a4c-8879-70c7c6165adc" returned: 0 in 0.457s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-5488f206-5996-4a4c-8879-70c7c6165adc" released by "_delete_snapshot" :: held 2.258s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.236s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.527s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=aef85ff6-9047-45b9-83ae-792bbc165694,created_at=2026-04-09T08:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-471817233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=aef85ff6-9047-45b9-83ae-792bbc165694,host='devstack@QuobyteHD#QuobyteHD',id=e288c76a-e164-4ddf-99f9-1002bd757171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:41Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cf9bfa-11cf-48a5-81db-c88047257d1d),volume_type_id=97cf9bfa-11cf-48a5-81db-c88047257d1d)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Creating volume e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:53 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2a1035-705d-4d9a-a827-5569eaaaf969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9', 'volume_size': 1, 'source_volid': '56678fd3-ce1f-44bd-bd85-6ee5fc336384', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:53 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1ab901-f419-4660-a868-2b1f187e712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:53 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 1073741824
Apr 09 10:42:53 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:54 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Volume volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 (0ce4e83e-5940-4f22-a770-408eb59aaaa9): created successfully
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1ab901-f419-4660-a868-2b1f187e712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (de6601ed-de69-477d-886d-9a83dff9734b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ab0fce35-9671-4214-bab8-6fd98676c5ba tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:42:54 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 1073741824" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:54 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171
Apr 09 10:42:54 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:54 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171" returned: 0 in 0.442s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.110s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1187873590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1430cffc-8d2e-4a32-9067-428a5760e28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1059e68f9051404ba2c850eb8a18f981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:47Z,use_quota=True,user_id='e16ada11acf24785ab27d4e077baa993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Creating volume 1430cffc-8d2e-4a32-9067-428a5760e28e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:54 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b37198-30e0-4942-a9ca-8f2983753fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e288c76a-e164-4ddf-99f9-1002bd757171', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:54 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e 1073741824
Apr 09 10:42:55 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336bb8c0-1eea-4d02-b8d2-9c9b404edcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:55 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Volume volume-e288c76a-e164-4ddf-99f9-1002bd757171 (e288c76a-e164-4ddf-99f9-1002bd757171): created successfully
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336bb8c0-1eea-4d02-b8d2-9c9b404edcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (0bd5a0fc-7274-4957-a641-7eab91e9e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6848bc7a-c986-477e-89c6-79d258e6f9e6 tempest-GroupSnapshotsTest-927558645 None] Created volume successfully.
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (fc105f02-22ec-4fa2-b014-80dfe33c43ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd5c125-230c-4e20-a620-663912e14d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd5c125-230c-4e20-a620-663912e14d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-405211481',display_name='tempest-VolumesGetTest-Volume-1998834850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc756a48-a837-447d-9465-b38f16e394ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:55Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d403ea07-adf3-4ef5-9887-4e656c364a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d403ea07-adf3-4ef5-9887-4e656c364a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de86e5b3-9564-4688-8e2d-6b81019cf6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de86e5b3-9564-4688-8e2d-6b81019cf6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc756a48-a837-447d-9465-b38f16e394ea', 'volume_name': 'volume-cc756a48-a837-447d-9465-b38f16e394ea', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a83d5b-e0ad-4394-9da7-9c014a73006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a83d5b-e0ad-4394-9da7-9c014a73006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110b4631-8e3d-4d49-844b-e9e82f3ae4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:55 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Volume cc756a48-a837-447d-9465-b38f16e394ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc756a48-a837-447d-9465-b38f16e394ea', 'volume_size': 1}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:55 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e 1073741824" returned: 0 in 0.636s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:55 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e
Apr 09 10:42:55 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:56 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-405211481',display_name='tempest-VolumesGetTest-Volume-1998834850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc756a48-a837-447d-9465-b38f16e394ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:55Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Creating volume cc756a48-a837-447d-9465-b38f16e394ea {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:56 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35f4f88-ca63-496c-969d-602a7bd9dacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1430cffc-8d2e-4a32-9067-428a5760e28e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39309fb8-fe6c-402a-9d72-9816350d980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea 1073741824
Apr 09 10:42:56 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Volume volume-1430cffc-8d2e-4a32-9067-428a5760e28e (1430cffc-8d2e-4a32-9067-428a5760e28e): created successfully
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39309fb8-fe6c-402a-9d72-9816350d980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Flow 'volume_create_manager' (68a7e007-6cac-4d2a-8b4d-2d33310aa64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:56 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-52dc6b6f-3f4f-4da8-8608-34e6b716430d tempest-VolumesListAdminTestJSON-72687887 None] Created volume successfully.
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (4d51ce5a-6b91-4b93-93c5-9c51688b6ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a2eb45-7e9f-4202-91a5-c881e286f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a2eb45-7e9f-4202-91a5-c881e286f94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1019861090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=aef85ff6-9047-45b9-83ae-792bbc165694,host='devstack@QuobyteHD#QuobyteHD',id=5e5087d7-e421-4b93-89a3-6a96adfcbed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:56Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cf9bfa-11cf-48a5-81db-c88047257d1d),volume_type_id=97cf9bfa-11cf-48a5-81db-c88047257d1d)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea1d522-6f89-4388-b622-af1f60a203ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea1d522-6f89-4388-b622-af1f60a203ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4740f87c-6dad-4b23-893e-a5c2ffd8200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4740f87c-6dad-4b23-893e-a5c2ffd8200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5087d7-e421-4b93-89a3-6a96adfcbed2', 'volume_name': 'volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e2ea4e-de74-447f-abc1-67a87ea1ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e2ea4e-de74-447f-abc1-67a87ea1ae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c721309-4ce5-44c0-b700-36df433a4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Volume 5e5087d7-e421-4b93-89a3-6a96adfcbed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2', 'volume_size': 1}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Flow 'volume_create_manager' (9598a3cc-cc55-413f-aeb7-4bb48c06b3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09aa209b-9cff-4ca1-afbb-de806821a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09aa209b-9cff-4ca1-afbb-de806821a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2093270311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c3a6db-6afd-40d8-85a6-81b2012b9045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1059e68f9051404ba2c850eb8a18f981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:57Z,use_quota=True,user_id='e16ada11acf24785ab27d4e077baa993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17778929-936d-4c56-924d-7743f421cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17778929-936d-4c56-924d-7743f421cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d2ce64-3931-41e2-9ed7-a12cefad87ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d2ce64-3931-41e2-9ed7-a12cefad87ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c3a6db-6afd-40d8-85a6-81b2012b9045', 'volume_name': 'volume-91c3a6db-6afd-40d8-85a6-81b2012b9045', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02836f93-3179-4867-9bdc-02199691919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02836f93-3179-4867-9bdc-02199691919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b53c63-786d-416a-9411-3448894f6382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Volume 91c3a6db-6afd-40d8-85a6-81b2012b9045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c3a6db-6afd-40d8-85a6-81b2012b9045', 'volume_size': 1}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:56 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea 1073741824" returned: 0 in 0.612s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:56 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea
Apr 09 10:42:56 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:57 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea" returned: 0 in 0.409s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=aef85ff6-9047-45b9-83ae-792bbc165694,created_at=2026-04-09T08:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1019861090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=aef85ff6-9047-45b9-83ae-792bbc165694,host='devstack@QuobyteHD#QuobyteHD',id=5e5087d7-e421-4b93-89a3-6a96adfcbed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:56Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cf9bfa-11cf-48a5-81db-c88047257d1d),volume_type_id=97cf9bfa-11cf-48a5-81db-c88047257d1d)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Creating volume 5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:57 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110b4631-8e3d-4d49-844b-e9e82f3ae4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc756a48-a837-447d-9465-b38f16e394ea', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df76480-3ef6-4797-b361-0d4359d05acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:57 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 1073741824
Apr 09 10:42:57 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:57 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Volume volume-cc756a48-a837-447d-9465-b38f16e394ea (cc756a48-a837-447d-9465-b38f16e394ea): created successfully
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df76480-3ef6-4797-b361-0d4359d05acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (fc105f02-22ec-4fa2-b014-80dfe33c43ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-48b29cea-32a3-458d-8118-334e952a05d0 tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-cc756a48-a837-447d-9465-b38f16e394ea-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Lock "cinder-cc756a48-a837-447d-9465-b38f16e394ea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-cc756a48-a837-447d-9465-b38f16e394ea" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-cc756a48-a837-447d-9465-b38f16e394ea" acquired by "delete_volume" :: waited 0.021s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d1918-cde7-4c63-a960-5999b4aa4f73]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:57 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 1073741824" returned: 0 in 0.607s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:57 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea
Apr 09 10:42:57 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:57 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2
Apr 09 10:42:57 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:58 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea" returned: 0 in 0.788s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:58 devstack sudo[86706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea
Apr 09 10:42:58 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:58 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2" returned: 0 in 0.786s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.981s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2093270311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c3a6db-6afd-40d8-85a6-81b2012b9045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1059e68f9051404ba2c850eb8a18f981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:42:57Z,use_quota=True,user_id='e16ada11acf24785ab27d4e077baa993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Creating volume 91c3a6db-6afd-40d8-85a6-81b2012b9045 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:42:58 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c721309-4ce5-44c0-b700-36df433a4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098ba345-f85a-4be6-a255-b40572ba07bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:42:58 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 1073741824
Apr 09 10:42:58 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:58 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Volume volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 (5e5087d7-e421-4b93-89a3-6a96adfcbed2): created successfully
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098ba345-f85a-4be6-a255-b40572ba07bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:42:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (4d51ce5a-6b91-4b93-93c5-9c51688b6ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:42:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-693ec99f-04a7-4586-9978-88fc9da0960f tempest-GroupSnapshotsTest-927558645 None] Created volume successfully.
Apr 09 10:42:59 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cc756a48-a837-447d-9465-b38f16e394ea" returned: 0 in 0.684s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-cc756a48-a837-447d-9465-b38f16e394ea" released by "delete_volume" :: held 1.498s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Created reservations ['90adc83d-1ca5-4a5a-bf6b-0dad5648a099', 'eafb52a8-ce28-4f94-b5c1-5a62bd923b49', '4f216931-f7bb-4754-a955-ad029ec8ece2', '3c92fd01-ab3d-4b1d-a380-3845d95a74b1'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:59 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 1073741824" returned: 0 in 0.696s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:42:59 devstack sudo[86715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:42:59 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:42:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:42:59 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045
Apr 09 10:42:59 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:00 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e093c8a2-afbb-40d3-bdcf-ba13d00755c9 tempest-GroupSnapshotsTest-927558645 None] Update group completed successfully.
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Flow 'volume_create_manager' (b4f00620-9730-42b3-a7a9-be6e2b608bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc55784c-d0be-4c44-a396-222572b8cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-0ce4e83e-5940-4f22-a770-408eb59aaaa9-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc55784c-d0be-4c44-a396-222572b8cab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-186668405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa098157-a202-4ee9-9643-9084677b8f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab95efa1cfe489891391eb624816c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:00Z,use_quota=True,user_id='4a3d821c8b1441bab8144037ee549f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0e4efa-8a15-46e5-abfd-807d4799edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0e4efa-8a15-46e5-abfd-807d4799edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54460e72-50cf-4982-a0e2-77b91eceda25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54460e72-50cf-4982-a0e2-77b91eceda25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa098157-a202-4ee9-9643-9084677b8f03', 'volume_name': 'volume-aa098157-a202-4ee9-9643-9084677b8f03', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091493dd-0da6-4c8e-bf9f-4f10e4558509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:00 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091493dd-0da6-4c8e-bf9f-4f10e4558509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cdfb3f-e7f8-44d8-82da-36791bbc70ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:00 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Volume aa098157-a202-4ee9-9643-9084677b8f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa098157-a202-4ee9-9643-9084677b8f03', 'volume_size': 1}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Lock "cinder-0ce4e83e-5940-4f22-a770-408eb59aaaa9-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045" returned: 0 in 0.926s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-186668405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa098157-a202-4ee9-9643-9084677b8f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab95efa1cfe489891391eb624816c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:00Z,use_quota=True,user_id='4a3d821c8b1441bab8144037ee549f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Creating volume aa098157-a202-4ee9-9643-9084677b8f03 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:00 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b53c63-786d-416a-9411-3448894f6382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c3a6db-6afd-40d8-85a6-81b2012b9045', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c57c9b9-401e-4910-a74b-9a270bdfb5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:00 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03 1073741824
Apr 09 10:43:00 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:00 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Volume volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 (91c3a6db-6afd-40d8-85a6-81b2012b9045): created successfully
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c57c9b9-401e-4910-a74b-9a270bdfb5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Flow 'volume_create_manager' (9598a3cc-cc55-413f-aeb7-4bb48c06b3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:00 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0fc7b28a-5109-44a5-afde-3e02e8d0646e tempest-VolumesListAdminTestJSON-72687887 None] Created volume successfully.
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-0ce4e83e-5940-4f22-a770-408eb59aaaa9" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-0ce4e83e-5940-4f22-a770-408eb59aaaa9" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:00 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 1.144s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:00 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d194450d-a445-4e87-8d16-1422785f354a tempest-VolumesGetTest-976428399 None] Lock "cinder-cc756a48-a837-447d-9465-b38f16e394ea-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f658358-2757-4279-b379-109e20561a8b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:00 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9
Apr 09 10:43:00 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:01 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9" returned: 0 in 0.756s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:01 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9
Apr 09 10:43:01 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:01 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03 1073741824" returned: 0 in 1.028s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:01 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a5951e1f-f0e7-4c65-aad8-b90a65e12aa4 tempest-GroupSnapshotsTest-927558645 None] Update group completed successfully.
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:01 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03
Apr 09 10:43:01 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Flow 'volume_create_manager' (2fdcd097-8b76-4a0e-821f-a93b449ac403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd38d419-536d-4aa3-9d62-c83c45f604c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd38d419-536d-4aa3-9d62-c83c45f604c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1148296491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0eaa2e-2f37-4448-a318-b0b2c213a107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1059e68f9051404ba2c850eb8a18f981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:01Z,use_quota=True,user_id='e16ada11acf24785ab27d4e077baa993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0407c2fc-5e23-4a3a-9e53-2e0512654eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0407c2fc-5e23-4a3a-9e53-2e0512654eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19c945e-a749-43dd-8655-e6c5c9f54879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19c945e-a749-43dd-8655-e6c5c9f54879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0eaa2e-2f37-4448-a318-b0b2c213a107', 'volume_name': 'volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400737d0-0a60-498c-8c10-ec767cc95754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400737d0-0a60-498c-8c10-ec767cc95754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f05d40c-77b6-4987-a8c2-7900292fc92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:01 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Volume 3b0eaa2e-2f37-4448-a318-b0b2c213a107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107', 'volume_size': 1}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:01 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0ce4e83e-5940-4f22-a770-408eb59aaaa9" returned: 0 in 0.512s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-0ce4e83e-5940-4f22-a770-408eb59aaaa9" released by "delete_volume" :: held 1.350s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Created reservations ['8a580850-dde9-4002-8385-e585cc2d4aa5', '3f23f294-1a4a-479d-9ad5-97a55b30ed78', '8db27d6e-4b1d-481d-be19-fc7f4bc6b0a4', '241a5462-5993-4028-b1a6-e4a2cc03aff5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:01 devstack sudo[86738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:01 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:02 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03" returned: 0 in 0.521s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1148296491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0eaa2e-2f37-4448-a318-b0b2c213a107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1059e68f9051404ba2c850eb8a18f981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:01Z,use_quota=True,user_id='e16ada11acf24785ab27d4e077baa993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Creating volume 3b0eaa2e-2f37-4448-a318-b0b2c213a107 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:02 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cdfb3f-e7f8-44d8-82da-36791bbc70ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa098157-a202-4ee9-9643-9084677b8f03', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88994a8f-3ef2-481d-9840-a445f7a0129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:02 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Volume volume-aa098157-a202-4ee9-9643-9084677b8f03 (aa098157-a202-4ee9-9643-9084677b8f03): created successfully
Apr 09 10:43:02 devstack sudo[86740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 1073741824
Apr 09 10:43:02 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88994a8f-3ef2-481d-9840-a445f7a0129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Flow 'volume_create_manager' (b4f00620-9730-42b3-a7a9-be6e2b608bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f3b9b7fc-8893-46e1-875c-cbfd9114d8ee tempest-ServerRescueNegativeTestJSON-1352799673 None] Created volume successfully.
Apr 09 10:43:02 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f0c1aff2-ee21-41bf-91f1-f89ef6070916 tempest-VolumesGetTest-976428399 None] Lock "cinder-0ce4e83e-5940-4f22-a770-408eb59aaaa9-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-56678fd3-ce1f-44bd-bd85-6ee5fc336384-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Lock "cinder-56678fd3-ce1f-44bd-bd85-6ee5fc336384-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-675d471f-2df6-403e-b0a0-240bca931c6f tempest-GroupSnapshotsTest-927558645 None] Update group completed successfully.
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-56678fd3-ce1f-44bd-bd85-6ee5fc336384" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-56678fd3-ce1f-44bd-bd85-6ee5fc336384" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a3908-4475-435d-bb8f-edbd96772d01]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:02 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:43:02 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:03 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 1073741824" returned: 0 in 0.941s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:03 devstack sudo[86750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107
Apr 09 10:43:03 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:03 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.544s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:03 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384
Apr 09 10:43:03 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:03 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107" returned: 0 in 0.435s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f05d40c-77b6-4987-a8c2-7900292fc92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e65f73e-153c-473b-a28b-dde55f007701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:03 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Volume volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 (3b0eaa2e-2f37-4448-a318-b0b2c213a107): created successfully
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e65f73e-153c-473b-a28b-dde55f007701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:03 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Flow 'volume_create_manager' (2fdcd097-8b76-4a0e-821f-a93b449ac403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:03 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3879c887-9de4-4a9e-a4e7-0110df08326b tempest-VolumesListAdminTestJSON-72687887 None] Created volume successfully.
Apr 09 10:43:03 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1b8ebc1f-4f58-4f93-9669-2f4207f1431a tempest-GroupSnapshotsTest-927558645 None] Update group completed successfully.
Apr 09 10:43:04 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Flow 'volume_create_manager' (f682d1dc-5197-4530-856b-cdf4cc322815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4b228-ec04-449a-9f45-63eaa0a938f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56678fd3-ce1f-44bd-bd85-6ee5fc336384" returned: 0 in 0.950s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-56678fd3-ce1f-44bd-bd85-6ee5fc336384" released by "delete_volume" :: held 1.570s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4b228-ec04-449a-9f45-63eaa0a938f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c376cefb-42af-4940-bc54-ab630dfe6c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90fd472b5fc48f3bdd47f2a62597183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:04Z,use_quota=True,user_id='b2c75482da874c08866ff66284641a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865d3d3e-727c-45a3-9c2f-b01b9b5ac00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865d3d3e-727c-45a3-9c2f-b01b9b5ac00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bf285e-a37f-4c66-b5cd-d53166de86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bf285e-a37f-4c66-b5cd-d53166de86d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c376cefb-42af-4940-bc54-ab630dfe6c29', 'volume_name': 'volume-c376cefb-42af-4940-bc54-ab630dfe6c29', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff923032-76f5-48ec-bec2-b4044c0767ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff923032-76f5-48ec-bec2-b4044c0767ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f80607-1337-49d6-8fdb-6a751e7e6443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:04 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Volume c376cefb-42af-4940-bc54-ab630dfe6c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c376cefb-42af-4940-bc54-ab630dfe6c29', 'volume_size': 1}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c376cefb-42af-4940-bc54-ab630dfe6c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90fd472b5fc48f3bdd47f2a62597183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:04Z,use_quota=True,user_id='b2c75482da874c08866ff66284641a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Creating volume c376cefb-42af-4940-bc54-ab630dfe6c29 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:04 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:04 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29 1073741824
Apr 09 10:43:04 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Created reservations ['fa95d62f-ca7d-4c0f-b52a-d389a11c0066', '9902c14e-57e4-4406-9e25-94695c906a70', 'ce536a30-b642-43c9-95a5-3e5d7c95201f', '39af45e7-38e7-42db-a390-8d1e339b2ddc'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:04 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:04 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:05 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:05 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a93cde5-c49f-498f-b8e4-154ba89068f5 tempest-VolumesGetTest-976428399 None] Lock "cinder-56678fd3-ce1f-44bd-bd85-6ee5fc336384-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:05 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29 1073741824" returned: 0 in 0.692s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:05 devstack sudo[86769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29
Apr 09 10:43:05 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:05 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] GroupSnapshot 04347cd2-26ac-436c-ba3b-023f1783dc68: creating.
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Group snapshot 04347cd2-26ac-436c-ba3b-023f1783dc68: creating. {{(pid=82783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:05 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29" returned: 0 in 0.651s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.477s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Creating offline snapshot ba5da4e8-600a-4e0a-8039-3c1b1ec39170 of volume 5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f80607-1337-49d6-8fdb-6a751e7e6443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c376cefb-42af-4940-bc54-ab630dfe6c29', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc96871b-da70-4f83-abb0-14e197955d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ce912-926c-4ab9-a482-e89438e9bc34]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:05 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Volume volume-c376cefb-42af-4940-bc54-ab630dfe6c29 (c376cefb-42af-4940-bc54-ab630dfe6c29): created successfully
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc96871b-da70-4f83-abb0-14e197955d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Flow 'volume_create_manager' (f682d1dc-5197-4530-856b-cdf4cc322815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:05 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-59989e72-f1bb-452d-9368-f31c1cd3bfaa tempest-VolumesListAdminTestJSON-25004581 None] Created volume successfully.
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (8e6e061d-475e-4270-af2a-1aa89af9bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452abdf5-0e7a-404a-b4a3-69c228407c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452abdf5-0e7a-404a-b4a3-69c228407c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745178336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2b414c-3df8-4b46-adc4-79bf2c44a4a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:06Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:05 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2
Apr 09 10:43:05 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c53f1b3-a15c-4b65-a33f-378185fe6a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c53f1b3-a15c-4b65-a33f-378185fe6a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2dca37-93c3-49da-8b43-366f2dba3ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:05 devstack cinder-volume[82783]: DEBUG cinder.image.glance [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Creating Keystone auth plugin from conf {{(pid=82783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2dca37-93c3-49da-8b43-366f2dba3ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f2b414c-3df8-4b46-adc4-79bf2c44a4a3', 'volume_name': 'volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6962986c20>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3663eba2-c30c-494b-8039-381721937e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3663eba2-c30c-494b-8039-381721937e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a423343-7c0f-4d78-bb5f-840cbe477576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Volume 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6962986c20>}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Trying to clone 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]). {{(pid=82783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 10:43:06 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[16151efc-1c52-4810-9d07-77802ba1b0d8]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:06 devstack sudo[86784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD
Apr 09 10:43:06 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:06 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2" returned: 0 in 0.831s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:06 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 1G
Apr 09 10:43:06 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Acquiring lock "cinder-c376cefb-42af-4940-bc54-ab630dfe6c29-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Lock "cinder-c376cefb-42af-4940-bc54-ab630dfe6c29-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Acquiring lock "cinder-quobyte-c376cefb-42af-4940-bc54-ab630dfe6c29" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Lock "cinder-quobyte-c376cefb-42af-4940-bc54-ab630dfe6c29" acquired by "delete_volume" :: waited 0.021s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[840d3db5-fdd2-4c72-8854-b771e26ea655]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "cinder-3b0eaa2e-2f37-4448-a318-b0b2c213a107-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-3b0eaa2e-2f37-4448-a318-b0b2c213a107-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "cinder-quobyte-3b0eaa2e-2f37-4448-a318-b0b2c213a107" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-quobyte-3b0eaa2e-2f37-4448-a318-b0b2c213a107" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c118b63-e9a2-444b-92b1-b09aa107dca1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:07 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29
Apr 09 10:43:07 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:07 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107
Apr 09 10:43:07 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:07 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD" returned: 0 in 0.946s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 is fetched for user 4047172e09de47629702bce6f069d920. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dbbc9d-1e3a-45b5-b417-969130765c61]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:07 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD
Apr 09 10:43:07 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:07 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 1G" returned: 0 in 0.962s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:07 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170
Apr 09 10:43:07 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:07 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29" returned: 0 in 0.867s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:07 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29
Apr 09 10:43:07 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:07 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107" returned: 0 in 0.750s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:07 devstack sudo[86833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107
Apr 09 10:43:07 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:08 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:08 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c376cefb-42af-4940-bc54-ab630dfe6c29" returned: 0 in 0.633s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Lock "cinder-quobyte-c376cefb-42af-4940-bc54-ab630dfe6c29" released by "delete_volume" :: held 1.529s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Created reservations ['eb1b829e-fd30-45d7-8560-a9a92dd00254', '70292d2e-6299-44bb-bdf4-f5ab2599bc50', '602c930d-7a36-463d-9ee4-b658927ff086', '6cedf72a-497e-4ceb-9937-0516f7e5905f'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:08 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:08 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:08 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170" returned: 0 in 0.860s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:08 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:08 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170
Apr 09 10:43:08 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:08 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b0eaa2e-2f37-4448-a318-b0b2c213a107" returned: 0 in 0.697s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-quobyte-3b0eaa2e-2f37-4448-a318-b0b2c213a107" released by "delete_volume" :: held 1.474s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Created reservations ['9fc08bee-6088-4cce-ab5a-d929ade07d96', '04a666d8-6e21-4f74-98c6-8b100bbca442', 'dbcce97e-6c08-4cc2-ae89-9c68c20bcdf2', '0396a60c-67cb-48f9-a124-60c3745adffe'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:08 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:08 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:08 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.476s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Deleted volume successfully.
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4cf188dc-888b-43f6-843b-f9b1927d82d9 tempest-VolumesListAdminTestJSON-25004581 None] Lock "cinder-c376cefb-42af-4940-bc54-ab630dfe6c29-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:08 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170" returned: 0 in 0.468s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:09 devstack sudo[86857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info
Apr 09 10:43:09 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:09 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.470s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:09 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Deleted volume successfully.
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c2e780f-5821-4bad-a03d-4de76a41b715 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-3b0eaa2e-2f37-4448-a318-b0b2c213a107-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "cinder-91c3a6db-6afd-40d8-85a6-81b2012b9045-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-91c3a6db-6afd-40d8-85a6-81b2012b9045-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "cinder-quobyte-91c3a6db-6afd-40d8-85a6-81b2012b9045" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-quobyte-91c3a6db-6afd-40d8-85a6-81b2012b9045" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeada5c-ccd6-4836-9baa-c9a80c4f64ce]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:09 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045
Apr 09 10:43:09 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:09 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:09 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:09 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info
Apr 09 10:43:09 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:09 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045" returned: 0 in 0.520s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:09 devstack sudo[86870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045
Apr 09 10:43:09 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:09 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.info" returned: 0 in 0.450s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.189s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Creating offline snapshot e3d29ec1-6169-44d8-a31f-d39ba1a4e897 of volume e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e456bb-2cdd-411a-b032-ba676225f977]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:10 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171
Apr 09 10:43:10 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:10 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-91c3a6db-6afd-40d8-85a6-81b2012b9045" returned: 0 in 0.412s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-quobyte-91c3a6db-6afd-40d8-85a6-81b2012b9045" released by "delete_volume" :: held 0.968s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Created reservations ['3f9d40e8-e9aa-40ce-988c-b3785c876693', '548a10cf-fce1-4bb1-825c-b20f6a25052c', '4267474b-de15-49ac-9bee-4960daa94133', '94b70093-34ef-430b-a364-1d2e63b146b3'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:10 devstack sudo[86876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:10 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:10 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171" returned: 0 in 0.542s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:10 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 1G
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "cinder-1430cffc-8d2e-4a32-9067-428a5760e28e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:10 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-1430cffc-8d2e-4a32-9067-428a5760e28e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "cinder-quobyte-1430cffc-8d2e-4a32-9067-428a5760e28e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-quobyte-1430cffc-8d2e-4a32-9067-428a5760e28e" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3936a-2e75-446b-9827-aec28ddcfe23]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:10 devstack sudo[86882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e
Apr 09 10:43:10 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:11 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.605s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Deleted volume successfully.
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a5dbec9a-8064-40e9-998f-6c2790b2bd06 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-91c3a6db-6afd-40d8-85a6-81b2012b9045-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:11 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 1G" returned: 0 in 0.600s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e288c76a-e164-4ddf-99f9-1002bd757171 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:11 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e288c76a-e164-4ddf-99f9-1002bd757171 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897
Apr 09 10:43:11 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:11 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e" returned: 0 in 0.557s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:11 devstack sudo[86912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e
Apr 09 10:43:11 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:11 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-1430cffc-8d2e-4a32-9067-428a5760e28e" returned: 0 in 0.582s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-quobyte-1430cffc-8d2e-4a32-9067-428a5760e28e" released by "delete_volume" :: held 1.166s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Created reservations ['e5342cde-3ddd-4637-9f39-ec74f419cf44', '8a693c16-047e-4d58-bb51-9017b898deec', 'c53af20b-ee54-4f5d-b0b5-899cfd2d2699', '641c12c5-6445-4b40-8e87-a8d109a825da'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:11 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e288c76a-e164-4ddf-99f9-1002bd757171 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897" returned: 0 in 0.792s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:11 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:11 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:11 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:11 devstack sudo[86930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897
Apr 09 10:43:11 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:12 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.484s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Deleted volume successfully.
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fe50acab-df70-4d83-8132-d9c12ef41686 tempest-VolumesListAdminTestJSON-72687887 None] Lock "cinder-1430cffc-8d2e-4a32-9067-428a5760e28e-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:12 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897" returned: 0 in 0.536s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:12 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info
Apr 09 10:43:12 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:12 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info" returned: 0 in 0.491s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:12 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:13 devstack sudo[86939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info
Apr 09 10:43:13 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:13 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.info" returned: 0 in 0.947s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.019s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.805s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745178336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2b414c-3df8-4b46-adc4-79bf2c44a4a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:06Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Creating volume 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:14 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:14 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 1073741824
Apr 09 10:43:14 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:14 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4d900c0d-5a1e-4869-913b-35126e87732a tempest-GroupSnapshotsTest-927558645 None] group_snapshot 04347cd2-26ac-436c-ba3b-023f1783dc68: created successfully
Apr 09 10:43:14 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] group_snapshot 04347cd2-26ac-436c-ba3b-023f1783dc68: deleting
Apr 09 10:43:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] group_snapshot 04347cd2-26ac-436c-ba3b-023f1783dc68: deleting {{(pid=82783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-5e5087d7-e421-4b93-89a3-6a96adfcbed2" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-5e5087d7-e421-4b93-89a3-6a96adfcbed2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-ba5da4e8-600a-4e0a-8039-3c1b1ec39170" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-ba5da4e8-600a-4e0a-8039-3c1b1ec39170" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Deleting offline snapshot ba5da4e8-600a-4e0a-8039-3c1b1ec39170 of volume 5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] snapshot_file for this snap is: volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[397eb312-932f-4c07-9025-0e30366be3c0]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:15 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 1073741824" returned: 0 in 1.237s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:15 devstack sudo[86949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:15 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:15 devstack sudo[86948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170
Apr 09 10:43:15 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:15 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 0 in 0.636s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:15 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Attempting download of f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 10:43:16 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170" returned: 0 in 0.825s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44a59fb-27f2-4f28-a34f-fc563f296303]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b711f8b-59b9-4e57-8980-a041c0e383fc]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:16 devstack sudo[86981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2
Apr 09 10:43:16 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:16 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p
Apr 09 10:43:16 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:16 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2" returned: 0 in 0.772s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:16 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170
Apr 09 10:43:16 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:17 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p" returned: 0 in 1.254s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:17 devstack sudo[87017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p
Apr 09 10:43:17 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:18 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170" returned: 0 in 1.176s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:18 devstack sudo[87023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170
Apr 09 10:43:18 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Acquiring lock "cinder-aa098157-a202-4ee9-9643-9084677b8f03-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "cinder-aa098157-a202-4ee9-9643-9084677b8f03-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Acquiring lock "cinder-quobyte-aa098157-a202-4ee9-9643-9084677b8f03" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "cinder-quobyte-aa098157-a202-4ee9-9643-9084677b8f03" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c52a6ea-f27e-4922-87d3-557173a3e309]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:18 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p" returned: 1 in 0.950s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_bvkefa3p' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f48fb5-3629-4799-9636-e6027d75436b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:18 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD
Apr 09 10:43:18 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:18 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03
Apr 09 10:43:18 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:19 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03" returned: 0 in 0.858s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:19 devstack sudo[87034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03
Apr 09 10:43:19 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:19 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2.ba5da4e8-600a-4e0a-8039-3c1b1ec39170" returned: 0 in 1.246s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-ba5da4e8-600a-4e0a-8039-3c1b1ec39170" released by "_delete_snapshot" :: held 4.248s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-5e5087d7-e421-4b93-89a3-6a96adfcbed2" released by "delete_snapshot" :: held 4.284s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-e288c76a-e164-4ddf-99f9-1002bd757171" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-e288c76a-e164-4ddf-99f9-1002bd757171" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-e3d29ec1-6169-44d8-a31f-d39ba1a4e897" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-e3d29ec1-6169-44d8-a31f-d39ba1a4e897" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Deleting offline snapshot e3d29ec1-6169-44d8-a31f-d39ba1a4e897 of volume e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:43:19 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] snapshot_file for this snap is: volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD" returned: 0 in 1.180s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] f4151152-a1b9-4cc0-94ca-126b9fa272f6 was qcow2, converting to raw {{(pid=82783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad8cd7-ae62-46a9-999f-94b0fa769eac]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:19 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:19 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:19 devstack sudo[87041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897
Apr 09 10:43:19 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:19 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-aa098157-a202-4ee9-9643-9084677b8f03" returned: 0 in 0.830s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "cinder-quobyte-aa098157-a202-4ee9-9643-9084677b8f03" released by "delete_volume" :: held 1.752s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Created reservations ['41bc602f-17d8-4421-8248-067a49b59007', 'c9daaa9b-04f3-4a6e-909f-d79993bfeae9', 'cdcaf4d9-8fc7-495a-88f9-553e8470e7c1', '06ae2593-e893-434b-bcd8-375688caf157'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:20 devstack sudo[87048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:20 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:20 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897" returned: 0 in 0.740s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e288c76a-e164-4ddf-99f9-1002bd757171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e71dc1b-613e-439e-b3e1-ff3f1dadadd7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:20 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171
Apr 09 10:43:20 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:20 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171" returned: 0 in 0.625s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:20 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897
Apr 09 10:43:20 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:21 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 0 in 1.931s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_v4afxq3xdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:43:21 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Converted 112.00 MB image at 57.97 MB/s
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:21 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 1G
Apr 09 10:43:21 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:21 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 1.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:21 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Deleted volume successfully.
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Flow 'volume_create_manager' (50efef1b-b18c-4379-8f72-a4d6fab71a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dedc19c-00fe-44d6-81c8-b6749fd70f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dedc19c-00fe-44d6-81c8-b6749fd70f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1806283936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68c15c-3e1e-45b8-9fac-de95f51ff4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c514b8e1dca74974a5775a9e3ae0893c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:22Z,use_quota=True,user_id='aaa8b2cbc297418e8de230100c997a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda885ee-1eb8-4bae-8f00-bcbfe9ba6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda885ee-1eb8-4bae-8f00-bcbfe9ba6637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:21 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4736847-0994-4579-a781-d13702fb52a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4736847-0994-4579-a781-d13702fb52a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d68c15c-3e1e-45b8-9fac-de95f51ff4d3', 'volume_name': 'volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8836fd3-2cfb-468a-8dae-8c8e47fd926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8836fd3-2cfb-468a-8dae-8c8e47fd926e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26faf00f-ca21-457f-a00c-28d7096a298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Volume 3d68c15c-3e1e-45b8-9fac-de95f51ff4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3', 'volume_size': 1}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1806283936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68c15c-3e1e-45b8-9fac-de95f51ff4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c514b8e1dca74974a5775a9e3ae0893c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:22Z,use_quota=True,user_id='aaa8b2cbc297418e8de230100c997a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Creating volume 3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:21 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0d5310e8-60bf-4a5f-8b47-e278728b8732 tempest-ServerRescueNegativeTestJSON-1352799673 None] Lock "cinder-aa098157-a202-4ee9-9643-9084677b8f03-delete_volume" released by "delete_volume" :: held 3.638s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897" returned: 0 in 0.907s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:21 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 1073741824
Apr 09 10:43:21 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:21 devstack sudo[87083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897
Apr 09 10:43:21 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:22 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 1G" returned: 0 in 0.758s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c841062a-58e4-4298-8813-511410db979e]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:22 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:22 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:22 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 1073741824" returned: 0 in 0.905s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:22 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3
Apr 09 10:43:22 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:22 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171.e3d29ec1-6169-44d8-a31f-d39ba1a4e897" returned: 0 in 0.926s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-e3d29ec1-6169-44d8-a31f-d39ba1a4e897" released by "_delete_snapshot" :: held 3.348s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-e288c76a-e164-4ddf-99f9-1002bd757171" released by "delete_snapshot" :: held 3.370s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:22 devstack cinder-volume[82783]: WARNING cinder.quota [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1367297437 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1367297437, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:43:22 devstack cinder-volume[82783]: WARNING cinder.quota [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1367297437 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1367297437, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['ada364b7-3405-47da-8be3-a1578cdc2fe3', 'e5033a6e-c24b-4e96-934e-7469cd4eac3a', 'e596a266-4fdb-4a2e-841e-48d0a57dfd04', 'e6c5062d-fdb2-4d60-a2f3-0686aa5fcc0d'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['c4bde9de-bcb6-4538-be66-fb34627e72c9', '661b9d6d-ceff-4fe9-9513-cddd451d5d2e', '50b35a00-9324-493e-a5d2-5a8c8a4a2735', 'b1cc9b51-8fd6-4401-ac1e-513162bc6806'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:22 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 0 in 0.688s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-68d53f4e-5c8e-4a0f-a27f-945e2dd76384 tempest-GroupSnapshotsTest-927558645 None] group_snapshot 04347cd2-26ac-436c-ba3b-023f1783dc68: deleted successfully
Apr 09 10:43:22 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:22 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:23 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3" returned: 0 in 0.426s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26faf00f-ca21-457f-a00c-28d7096a298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43572b5-2c3b-4535-bed7-96a1017db104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:23 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Volume volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 (3d68c15c-3e1e-45b8-9fac-de95f51ff4d3): created successfully
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43572b5-2c3b-4535-bed7-96a1017db104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Flow 'volume_create_manager' (50efef1b-b18c-4379-8f72-a4d6fab71a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:23 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7fa6e9d1-d8ba-4e72-9319-1a2a606d5874 tempest-AbsoluteLimitsTests-1041788374 None] Created volume successfully.
Apr 09 10:43:23 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 1 in 0.511s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Downloaded image f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 successfully. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 for user 4047172e09de47629702bce6f069d920 is deleted. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Marking volume 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 as bootable. {{(pid=82783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Copying metadata from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 to 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3. {{(pid=82783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Creating volume glance metadata for volume 0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 backed by image f4151152-a1b9-4cc0-94ca-126b9fa272f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a423343-7c0f-4d78-bb5f-840cbe477576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6962986c20>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eccb1a-80f2-4d6b-a84f-e790e1520e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:23 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Volume volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 (0f2b414c-3df8-4b46-adc4-79bf2c44a4a3): created successfully
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eccb1a-80f2-4d6b-a84f-e790e1520e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (8e6e061d-475e-4270-af2a-1aa89af9bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:23 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fe2b894f-b1b7-426d-8c55-fec8d8c78919 tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-5e5087d7-e421-4b93-89a3-6a96adfcbed2" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-5e5087d7-e421-4b93-89a3-6a96adfcbed2" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f98f8-5d99-4791-8b90-27beae5b6cad]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:23 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2
Apr 09 10:43:23 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Acquiring lock "cinder-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Lock "cinder-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Acquiring lock "cinder-quobyte-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Lock "cinder-quobyte-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa596dfb-f05a-4e61-ad13-3c825df2af14]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:24 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3
Apr 09 10:43:24 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:24 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2" returned: 0 in 0.547s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:24 devstack sudo[87135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2
Apr 09 10:43:24 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:24 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3" returned: 0 in 0.572s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:24 devstack sudo[87140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3
Apr 09 10:43:24 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (d1d9c384-f49f-46ce-b7c9-da7b6c739b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72df1fe-cd58-48d0-9da2-04a3a9eca225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72df1fe-cd58-48d0-9da2-04a3a9eca225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1876797443',display_name='tempest-VolumesGetTest-Volume-648354814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55de8d36-1de8-4154-bc44-858c85e46e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:25Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d02e56c-efd4-431f-87a4-152702c8b504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d02e56c-efd4-431f-87a4-152702c8b504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576b17d7-16f6-42db-93eb-b8e2069d76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576b17d7-16f6-42db-93eb-b8e2069d76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55de8d36-1de8-4154-bc44-858c85e46e60', 'volume_name': 'volume-55de8d36-1de8-4154-bc44-858c85e46e60', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30fcac1-7f25-4a9d-bc37-576854abbeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30fcac1-7f25-4a9d-bc37-576854abbeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e0c08-6bfc-46bc-a23b-47211da56d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:24 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Volume 55de8d36-1de8-4154-bc44-858c85e46e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55de8d36-1de8-4154-bc44-858c85e46e60', 'volume_size': 1}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1876797443',display_name='tempest-VolumesGetTest-Volume-648354814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55de8d36-1de8-4154-bc44-858c85e46e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5ad5b0f22448228d0155c3d0576534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:25Z,use_quota=True,user_id='4047172e09de47629702bce6f069d920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Creating volume 55de8d36-1de8-4154-bc44-858c85e46e60 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:24 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:25 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60 1073741824
Apr 09 10:43:25 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:25 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5e5087d7-e421-4b93-89a3-6a96adfcbed2" returned: 0 in 0.635s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-5e5087d7-e421-4b93-89a3-6a96adfcbed2" released by "delete_volume" :: held 1.213s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-e288c76a-e164-4ddf-99f9-1002bd757171" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-e288c76a-e164-4ddf-99f9-1002bd757171" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[db212d46-e745-4408-bec1-b227815231b4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:25 devstack sudo[87145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171
Apr 09 10:43:25 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:25 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3" returned: 0 in 0.552s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Lock "cinder-quobyte-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3" released by "delete_volume" :: held 1.151s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Created reservations ['27df5df2-a095-46f0-b421-99693d43b957', 'eda503db-fd36-4c94-bbe2-a53efd7c4933', '4cce2fa9-fb25-4a7b-9d13-5f2c5d93948f', '46a97624-b3b3-4a80-9043-f1489102f0da'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:25 devstack sudo[87148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:25 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:25 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:25 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60 1073741824" returned: 0 in 0.626s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:25 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171
Apr 09 10:43:25 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:25 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60
Apr 09 10:43:25 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:25 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Deleted volume successfully.
Apr 09 10:43:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-044f745e-3f25-4527-a738-99b1af7ee091 tempest-AbsoluteLimitsTests-1041788374 None] Lock "cinder-3d68c15c-3e1e-45b8-9fac-de95f51ff4d3-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:26 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e288c76a-e164-4ddf-99f9-1002bd757171" returned: 0 in 0.515s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-e288c76a-e164-4ddf-99f9-1002bd757171" released by "delete_volume" :: held 1.068s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:26 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e0c08-6bfc-46bc-a23b-47211da56d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55de8d36-1de8-4154-bc44-858c85e46e60', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4618b-1369-4580-9fc8-b8f462e0b85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:26 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Volume volume-55de8d36-1de8-4154-bc44-858c85e46e60 (55de8d36-1de8-4154-bc44-858c85e46e60): created successfully
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4618b-1369-4580-9fc8-b8f462e0b85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Flow 'volume_create_manager' (d1d9c384-f49f-46ce-b7c9-da7b6c739b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ab60f3d6-8c6b-4e57-b91f-fec86ace9b12 tempest-VolumesGetTest-976428399 None] Created volume successfully.
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['f5a259d7-cf4b-44a4-bb79-6a6b11e8aaa4'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:26 devstack cinder-volume[82783]: WARNING cinder.quota [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1367297437 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1367297437, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['ff181e7a-4456-40f3-adb3-3cea3f547d7a', '83c44f53-b35c-4fb4-af9e-87534aa2997c', 'e4d0c6a7-1855-4dc5-9666-429db622ab6c', '73e0a4f1-610d-4e8e-ab9d-aac6173dec04'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Created reservations ['574437e8-163f-4d1f-bb39-63cb63f43c57', 'd2ada2ec-0a5e-4295-aedc-e5cd182224af', '3d269da1-7781-46f0-8ab3-abf3f8a3d0ab', '0d295629-4661-4a80-97cf-c291d2d39605'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:26 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:26 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:26 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:26 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-97740542-a4cf-48b1-b2d0-8f58b21b89f8 tempest-GroupSnapshotsTest-927558645 None] Delete group completed successfully.
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-55de8d36-1de8-4154-bc44-858c85e46e60-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Lock "cinder-55de8d36-1de8-4154-bc44-858c85e46e60-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-55de8d36-1de8-4154-bc44-858c85e46e60" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-55de8d36-1de8-4154-bc44-858c85e46e60" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[04adda76-4839-447e-b03a-add7c72ca744]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:27 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60
Apr 09 10:43:27 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1927be0f-54b9-4e22-95cf-6ea8ebaeefa2 tempest-GroupSnapshotsTest-927558645 None] Group tempest-GroupSnapshotsTest-Group-2110789098: creating
Apr 09 10:43:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1927be0f-54b9-4e22-95cf-6ea8ebaeefa2 tempest-GroupSnapshotsTest-927558645 None] Group tempest-GroupSnapshotsTest-Group-2110789098: created successfully
Apr 09 10:43:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1927be0f-54b9-4e22-95cf-6ea8ebaeefa2 tempest-GroupSnapshotsTest-927558645 None] Create group completed successfully.
Apr 09 10:43:27 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60" returned: 0 in 0.747s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:28 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60
Apr 09 10:43:28 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:28 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-55de8d36-1de8-4154-bc44-858c85e46e60" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-55de8d36-1de8-4154-bc44-858c85e46e60" released by "delete_volume" :: held 1.326s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:INSERT=58,cinder:UPDATE=236,cinder:SELECT=189,cinder:DELETE=11 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Created reservations ['c370fb8a-3760-4f58-903e-a5a83be76c90', 'ebb56352-7c9e-4411-b95e-0aa45d7f23c9', '97eeb8a1-0ebe-4639-9679-0883ec58309c', '6bfa7f99-495e-4b31-b962-7d61b3e49ea4'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:28 devstack sudo[87202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:28 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (07f72ddc-f6b7-4792-b0ac-5172b5d2950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e36b685-29da-46c3-83ca-21344c9f2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e36b685-29da-46c3-83ca-21344c9f2c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094675734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e2480a9f-f09f-470c-9ebd-320025e2f54e,host='devstack@QuobyteHD#QuobyteHD',id=8890e1b6-8164-4a19-9d11-a5133472cf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:29Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602c7425-8398-49d8-b70e-b6fee2bf9359),volume_type_id=602c7425-8398-49d8-b70e-b6fee2bf9359)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e303cf5d-6f10-486d-8863-ee3405d9e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e303cf5d-6f10-486d-8863-ee3405d9e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf53ba85-85b3-43c0-8d6f-f87ecd8d603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf53ba85-85b3-43c0-8d6f-f87ecd8d603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8890e1b6-8164-4a19-9d11-a5133472cf19', 'volume_name': 'volume-8890e1b6-8164-4a19-9d11-a5133472cf19', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd30cf0-3e26-4c34-9647-071ef8a8c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd30cf0-3e26-4c34-9647-071ef8a8c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643879f3-41d7-4d63-82e4-564479d203b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:29 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Volume 8890e1b6-8164-4a19-9d11-a5133472cf19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8890e1b6-8164-4a19-9d11-a5133472cf19', 'volume_size': 1}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e2480a9f-f09f-470c-9ebd-320025e2f54e,created_at=2026-04-09T08:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094675734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e2480a9f-f09f-470c-9ebd-320025e2f54e,host='devstack@QuobyteHD#QuobyteHD',id=8890e1b6-8164-4a19-9d11-a5133472cf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f702195b10c347ecb929d0c26074462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:29Z,use_quota=True,user_id='16121bae8fe64e46a110450bd353db16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602c7425-8398-49d8-b70e-b6fee2bf9359),volume_type_id=602c7425-8398-49d8-b70e-b6fee2bf9359)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Creating volume 8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:29 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:29 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 1073741824
Apr 09 10:43:29 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:29 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.537s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:29 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-34bda941-7ff3-400e-8d2b-d4fab0ea0717 tempest-VolumesGetTest-976428399 None] Lock "cinder-55de8d36-1de8-4154-bc44-858c85e46e60-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Lock "cinder-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Acquiring lock "cinder-quobyte-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[824a8080-7115-46ca-858c-c9c79761d7c0]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:29 devstack sudo[87208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:29 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:29 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 1073741824" returned: 0 in 0.540s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:29 devstack sudo[87214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19
Apr 09 10:43:29 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:30 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 0 in 0.627s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:30 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:30 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:UPDATE=212,cinder:SELECT=169,cinder:INSERT=56,cinder:DELETE=16 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:43:30 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Flow 'volume_create_manager' (79c3c76a-bb0b-4888-a37b-bd6f3ff3a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89de860-ce5a-4cba-b24c-c625b981eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19" returned: 0 in 0.610s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643879f3-41d7-4d63-82e4-564479d203b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8890e1b6-8164-4a19-9d11-a5133472cf19', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42241814-261a-41fa-9f65-fdfbc479f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89de860-ce5a-4cba-b24c-c625b981eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1650107408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c4136c-1c9a-4e0a-bf5a-be65a597b68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0878bcaecd304c018c30ce4b3987c7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:30Z,use_quota=True,user_id='f902bdd63ff44e44b0b8c9c5dac1cbb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f561452-fb04-41d0-9d64-7181d6cbb647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f561452-fb04-41d0-9d64-7181d6cbb647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e18d29-3838-449c-b333-26b376efce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e18d29-3838-449c-b333-26b376efce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c4136c-1c9a-4e0a-bf5a-be65a597b68f', 'volume_name': 'volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75efdb41-fae4-453a-a2f4-bd6d3fbd7418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75efdb41-fae4-453a-a2f4-bd6d3fbd7418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcab9fe6-c64c-48a3-8119-ff019e0e22a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:30 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Volume 05c4136c-1c9a-4e0a-bf5a-be65a597b68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f', 'volume_size': 1}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1650107408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c4136c-1c9a-4e0a-bf5a-be65a597b68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0878bcaecd304c018c30ce4b3987c7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:30Z,use_quota=True,user_id='f902bdd63ff44e44b0b8c9c5dac1cbb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Creating volume 05c4136c-1c9a-4e0a-bf5a-be65a597b68f {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:30 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:30 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Volume volume-8890e1b6-8164-4a19-9d11-a5133472cf19 (8890e1b6-8164-4a19-9d11-a5133472cf19): created successfully
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42241814-261a-41fa-9f65-fdfbc479f573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:30 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f 1073741824
Apr 09 10:43:30 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Flow 'volume_create_manager' (07f72ddc-f6b7-4792-b0ac-5172b5d2950e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:30 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f2b1d3ff-d18d-408d-858d-05aa40c7b9ba tempest-GroupSnapshotsTest-927558645 None] Created volume successfully.
Apr 09 10:43:30 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 1 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:30 devstack sudo[87227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3
Apr 09 10:43:30 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:30 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f 1073741824" returned: 0 in 0.516s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:30 devstack sudo[87232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f
Apr 09 10:43:30 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:31 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" returned: 0 in 0.416s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Lock "cinder-quobyte-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3" released by "delete_volume" :: held 1.625s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Created reservations ['8119a125-ce4c-4419-b3ba-99bd0211e4f8', '8409f16b-be7b-4dac-8cd5-fbe317a4b859', '0c01fde9-f9d3-44d1-b37d-a39608c8f192', '7026e859-56a3-4a14-ad6d-9af5b1b6e1a1'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:31 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:31 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] GroupSnapshot 359a4b02-454f-4a8b-983a-28a8b124f0a7: creating.
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Group snapshot 359a4b02-454f-4a8b-983a-28a8b124f0a7: creating. {{(pid=82783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:31 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcab9fe6-c64c-48a3-8119-ff019e0e22a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678e31e1-36cb-4bce-82b5-9a7395ca69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Creating offline snapshot 25584805-7c1a-45f6-bf99-47e7fb7fbd39 of volume 8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:43:31 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Volume volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f (05c4136c-1c9a-4e0a-bf5a-be65a597b68f): created successfully
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678e31e1-36cb-4bce-82b5-9a7395ca69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Flow 'volume_create_manager' (79c3c76a-bb0b-4888-a37b-bd6f3ff3a134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5090e1d0-0f34-4676-bd4a-88b22621de57]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b0b7cbae-5059-4c5d-87e6-dd7f840aea13 tempest-VolumesTransfersTest-537540930 None] Created volume successfully.
Apr 09 10:43:31 devstack sudo[87238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19
Apr 09 10:43:31 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:31 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Deleted volume successfully.
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ebc4138e-4881-4b0f-85e8-27f022ba408e tempest-VolumesGetTest-976428399 None] Lock "cinder-0f2b414c-3df8-4b46-adc4-79bf2c44a4a3-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:31 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19" returned: 0 in 0.522s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:32 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 1G
Apr 09 10:43:32 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:32 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 1G" returned: 0 in 0.672s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8890e1b6-8164-4a19-9d11-a5133472cf19 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:32 devstack sudo[87250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8890e1b6-8164-4a19-9d11-a5133472cf19 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39
Apr 09 10:43:32 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a6f7430d-d9ee-48cb-828f-57d78f8d17d5 tempest-VolumesTransfersTest-1001692542 None] Transfer volume completed successfully.
Apr 09 10:43:33 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8890e1b6-8164-4a19-9d11-a5133472cf19 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:33 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:33 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39
Apr 09 10:43:33 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (c56cdabb-2722-4471-a236-ad7908848c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cd0d68-83de-46fb-b3ce-724b71add8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cd0d68-83de-46fb-b3ce-724b71add8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1805019281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab502f1-2821-4085-9a1f-6cad218f5e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:33Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb80e1d-169e-4167-ad99-777db7e73aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb80e1d-169e-4167-ad99-777db7e73aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697f306d-27f4-4f58-869d-83354b347a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697f306d-27f4-4f58-869d-83354b347a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab502f1-2821-4085-9a1f-6cad218f5e7d', 'volume_name': 'volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9956583-10da-4f6f-b254-76072b6beb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9956583-10da-4f6f-b254-76072b6beb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b78649-6a4e-4241-ab4e-87d131f7a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Volume 3ab502f1-2821-4085-9a1f-6cad218f5e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d', 'volume_size': 1}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:33 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:33 devstack sudo[87258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info
Apr 09 10:43:33 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Acquiring lock "cinder-05c4136c-1c9a-4e0a-bf5a-be65a597b68f-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-05c4136c-1c9a-4e0a-bf5a-be65a597b68f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (e43cd592-7f55-45aa-b0ee-ced41a544fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed62364-9fac-46ef-8180-465e2dceb032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed62364-9fac-46ef-8180-465e2dceb032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1744303494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26492a9-660d-48d4-8091-deb7d805edec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:34Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d22c69-1fc7-4357-81e8-0e7bf5047779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d22c69-1fc7-4357-81e8-0e7bf5047779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f889402e-2b54-49d8-b603-569e34f5d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f889402e-2b54-49d8-b603-569e34f5d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26492a9-660d-48d4-8091-deb7d805edec', 'volume_name': 'volume-d26492a9-660d-48d4-8091-deb7d805edec', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a7c601-5ed2-4191-8754-a6866f2e71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a7c601-5ed2-4191-8754-a6866f2e71dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47681571-7d07-4375-8e9f-07edae02ddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Volume d26492a9-660d-48d4-8091-deb7d805edec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26492a9-660d-48d4-8091-deb7d805edec', 'volume_size': 1}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Acquiring lock "cinder-quobyte-05c4136c-1c9a-4e0a-bf5a-be65a597b68f" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-quobyte-05c4136c-1c9a-4e0a-bf5a-be65a597b68f" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32792cb-2868-426e-96a7-90894cd49bd9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:34 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f
Apr 09 10:43:34 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (bd78792c-399a-4e60-9186-9cf163014dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c32d41-a732-4b22-8f8a-aa7b80cebf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c32d41-a732-4b22-8f8a-aa7b80cebf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673660945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c92c8e9-ba9b-4668-b66e-f2cdb8acc939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:34Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae2865f-260f-4d3a-9404-c02743e285e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae2865f-260f-4d3a-9404-c02743e285e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e908c22-cf8a-4f02-b7bf-3972f65ea40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e908c22-cf8a-4f02-b7bf-3972f65ea40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c92c8e9-ba9b-4668-b66e-f2cdb8acc939', 'volume_name': 'volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514bada1-21b6-44dd-9225-f728f03e58db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514bada1-21b6-44dd-9225-f728f03e58db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f34b32-96c7-43da-9f8c-d34e14432797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Volume 3c92c8e9-ba9b-4668-b66e-f2cdb8acc939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939', 'volume_size': 1}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:34 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:34 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:34 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info
Apr 09 10:43:34 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (6adb8307-6b28-48cd-90d8-6fd02c4af330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f18b983-a8e8-44e2-974d-2bedb633cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f18b983-a8e8-44e2-974d-2bedb633cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-998220887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85467539-86e5-45eb-97cc-814358fa2f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:34Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e128cc-ce61-470e-b733-82e9589226ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e128cc-ce61-470e-b733-82e9589226ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ba4cd0-4dfe-44a4-8e71-ecb5b474cf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ba4cd0-4dfe-44a4-8e71-ecb5b474cf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85467539-86e5-45eb-97cc-814358fa2f60', 'volume_name': 'volume-85467539-86e5-45eb-97cc-814358fa2f60', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66f154-f0ea-45a6-aa8a-7ea73dbd94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66f154-f0ea-45a6-aa8a-7ea73dbd94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ab8b67-4d15-4b5a-9bc4-7b45c597846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Volume 85467539-86e5-45eb-97cc-814358fa2f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85467539-86e5-45eb-97cc-814358fa2f60', 'volume_size': 1}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (fc201375-2cc1-43a2-beec-842279d16eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18289f6c-68b8-436a-a6df-1e2c0ba5c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18289f6c-68b8-436a-a6df-1e2c0ba5c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1924227043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3e9472-b627-4389-a8b9-7041c4ceb4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:35Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91422a72-b630-472b-a720-21549d1dac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91422a72-b630-472b-a720-21549d1dac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb8e60-61b1-43c2-9df7-34aec6a5baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb8e60-61b1-43c2-9df7-34aec6a5baba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3e9472-b627-4389-a8b9-7041c4ceb4af', 'volume_name': 'volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4c62bc-dc3e-4fef-8a76-767d76db9076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4c62bc-dc3e-4fef-8a76-767d76db9076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f12df9-e72d-47d7-88d2-3cf1a3f5d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Volume 7e3e9472-b627-4389-a8b9-7041c4ceb4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af', 'volume_size': 1}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:34 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.info" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.297s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1805019281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab502f1-2821-4085-9a1f-6cad218f5e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:33Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Creating volume 3ab502f1-2821-4085-9a1f-6cad218f5e7d {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:34 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:34 devstack sudo[87269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d 1073741824
Apr 09 10:43:34 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:34 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f" returned: 0 in 0.770s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:34 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f
Apr 09 10:43:34 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b00a77a7-9646-499f-9a71-86249f220213 tempest-GroupSnapshotsTest-927558645 None] group_snapshot 359a4b02-454f-4a8b-983a-28a8b124f0a7: created successfully
Apr 09 10:43:35 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05c4136c-1c9a-4e0a-bf5a-be65a597b68f" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-quobyte-05c4136c-1c9a-4e0a-bf5a-be65a597b68f" released by "delete_volume" :: held 1.230s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Created reservations ['d055e32a-6892-4ad9-a9b8-a813b274c2f9', 'e535883e-6c49-466f-885c-7778c8594e87', 'e8cab229-4618-4280-8aa6-f68e0aa1d283', '6d4c9172-e7e0-49c3-b1b9-d7c7346df723'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:35 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d 1073741824" returned: 0 in 0.552s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:35 devstack sudo[87278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:35 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:35 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:35 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:35 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d" returned: 0 in 0.525s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1744303494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26492a9-660d-48d4-8091-deb7d805edec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:34Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Creating volume d26492a9-660d-48d4-8091-deb7d805edec {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:35 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] group_snapshot 359a4b02-454f-4a8b-983a-28a8b124f0a7: deleting
Apr 09 10:43:35 devstack sudo[87284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec 1073741824
Apr 09 10:43:35 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b78649-6a4e-4241-ab4e-87d131f7a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc202799-d6dd-422e-8a90-f5c4e84d5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:35 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Volume volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d (3ab502f1-2821-4085-9a1f-6cad218f5e7d): created successfully
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc202799-d6dd-422e-8a90-f5c4e84d5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:35 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (c56cdabb-2722-4471-a236-ad7908848c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] group_snapshot 359a4b02-454f-4a8b-983a-28a8b124f0a7: deleting {{(pid=82783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.580s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-38da53be-a832-4930-953b-301779d97ad7 tempest-CreateVolumesFromImageTest-1739077905 None] Created volume successfully.
Apr 09 10:43:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Deleted volume successfully.
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-8890e1b6-8164-4a19-9d11-a5133472cf19" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-8890e1b6-8164-4a19-9d11-a5133472cf19" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-25584805-7c1a-45f6-bf99-47e7fb7fbd39" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9d338a3-2422-463a-9a04-29bea7940876 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-05c4136c-1c9a-4e0a-bf5a-be65a597b68f-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-25584805-7c1a-45f6-bf99-47e7fb7fbd39" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Deleting offline snapshot 25584805-7c1a-45f6-bf99-47e7fb7fbd39 of volume 8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] snapshot_file for this snap is: volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82a138a-a5a7-4939-afe2-56fc1a26ee2d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:36 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39
Apr 09 10:43:36 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Flow 'volume_create_manager' (dd73e6c5-ecb3-45e3-aa19-2719e30ff6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36febbd-ae3d-4af5-982c-c1fb106e335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36febbd-ae3d-4af5-982c-c1fb106e335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-117842167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60893a38-eaec-4024-8bbf-de1f199f7602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0878bcaecd304c018c30ce4b3987c7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:36Z,use_quota=True,user_id='f902bdd63ff44e44b0b8c9c5dac1cbb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303bf407-bf5d-479f-b2c7-3c488e5bcf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303bf407-bf5d-479f-b2c7-3c488e5bcf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52137126-90d4-4dbf-b894-f8aab34b3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52137126-90d4-4dbf-b894-f8aab34b3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60893a38-eaec-4024-8bbf-de1f199f7602', 'volume_name': 'volume-60893a38-eaec-4024-8bbf-de1f199f7602', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2612bcbe-f668-4379-a3da-e2b7f880db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2612bcbe-f668-4379-a3da-e2b7f880db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2a2a3e-4a1a-4efc-bfc7-b2bfbf68bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:36 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Volume 60893a38-eaec-4024-8bbf-de1f199f7602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60893a38-eaec-4024-8bbf-de1f199f7602', 'volume_size': 1}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:36 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec 1073741824" returned: 0 in 0.635s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:36 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec
Apr 09 10:43:36 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:36 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39" returned: 0 in 0.615s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8890e1b6-8164-4a19-9d11-a5133472cf19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdc4b0e-7ff6-49d2-a436-26f19156efce]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:36 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19
Apr 09 10:43:36 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:36 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec" returned: 0 in 0.452s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.745s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673660945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c92c8e9-ba9b-4668-b66e-f2cdb8acc939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:34Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Creating volume 3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:36 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47681571-7d07-4375-8e9f-07edae02ddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26492a9-660d-48d4-8091-deb7d805edec', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:36 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 1073741824
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8853e004-3be5-49a5-a4b8-10512e000f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:36 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:36 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Volume volume-d26492a9-660d-48d4-8091-deb7d805edec (d26492a9-660d-48d4-8091-deb7d805edec): created successfully
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8853e004-3be5-49a5-a4b8-10512e000f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (e43cd592-7f55-45aa-b0ee-ced41a544fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-876609ad-9090-43ee-8489-8e2c744af5b0 tempest-CreateVolumesFromImageTest-1739077905 None] Created volume successfully.
Apr 09 10:43:37 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19" returned: 0 in 0.586s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:37 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39
Apr 09 10:43:37 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:37 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 1073741824" returned: 0 in 0.539s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:37 devstack sudo[87311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939
Apr 09 10:43:37 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:37 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39" returned: 0 in 0.561s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:37 devstack sudo[87316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39
Apr 09 10:43:37 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:37 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939" returned: 0 in 0.452s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.594s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-998220887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85467539-86e5-45eb-97cc-814358fa2f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:34Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Creating volume 85467539-86e5-45eb-97cc-814358fa2f60 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:37 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f34b32-96c7-43da-9f8c-d34e14432797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8a4f67-49c4-4baa-8612-c478c1fcded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Volume volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 (3c92c8e9-ba9b-4668-b66e-f2cdb8acc939): created successfully
Apr 09 10:43:38 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60 1073741824
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8a4f67-49c4-4baa-8612-c478c1fcded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:38 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (bd78792c-399a-4e60-9186-9cf163014dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-928d430b-3b19-41b9-9daf-c9918c449b8b tempest-CreateVolumesFromImageTest-1739077905 None] Created volume successfully.
Apr 09 10:43:38 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19.25584805-7c1a-45f6-bf99-47e7fb7fbd39" returned: 0 in 0.468s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-25584805-7c1a-45f6-bf99-47e7fb7fbd39" released by "_delete_snapshot" :: held 2.316s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-8890e1b6-8164-4a19-9d11-a5133472cf19" released by "delete_snapshot" :: held 2.332s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:38 devstack cinder-volume[82783]: WARNING cinder.quota [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-671321513 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-671321513, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:43:38 devstack cinder-volume[82783]: WARNING cinder.quota [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-671321513 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-671321513, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] Created reservations ['bc39174b-c3df-442a-8a96-326de79c215b', '3a9b4599-1905-4490-9e81-97a535f9ee34', '591bcc49-1558-41f5-8fd4-ce721255deaa', '35f888cc-b5e1-436e-b1c1-e41c3fd47eac'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-669d7d8f-8a6f-4562-99c7-e149a71109ea tempest-GroupSnapshotsTest-927558645 None] group_snapshot 359a4b02-454f-4a8b-983a-28a8b124f0a7: deleted successfully
Apr 09 10:43:38 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60 1073741824" returned: 0 in 0.590s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:38 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60
Apr 09 10:43:38 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Flow 'volume_create_manager' (9f84bcdf-0ada-4da8-b58a-eca12ce0fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b67842e-3899-4d91-a789-063ad62af6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b67842e-3899-4d91-a789-063ad62af6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1296050683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a955055-e3a2-496e-8bbd-df8d5b21e8d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c554241594a6987aadf99593fd555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:39Z,use_quota=True,user_id='e317d912c76a49a7aabfc09b9267ccf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027c3d0e-1ac7-47ac-9a87-abe109101635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027c3d0e-1ac7-47ac-9a87-abe109101635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb383b08-617a-44aa-9915-3c47244e13a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb383b08-617a-44aa-9915-3c47244e13a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a955055-e3a2-496e-8bbd-df8d5b21e8d2', 'volume_name': 'volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e51f9cf-1459-4f68-9109-083e0bd90cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e51f9cf-1459-4f68-9109-083e0bd90cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87b2820-a7d6-48f0-b9d5-05b2b34b378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Volume 6a955055-e3a2-496e-8bbd-df8d5b21e8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2', 'volume_size': 1}
Apr 09 10:43:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:39 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1924227043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3e9472-b627-4389-a8b9-7041c4ceb4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466eec80eaa44888b1b078e671e5dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:35Z,use_quota=True,user_id='f5b50fc56d6a4552a3beb48db55e1213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Creating volume 7e3e9472-b627-4389-a8b9-7041c4ceb4af {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:39 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ab8b67-4d15-4b5a-9bc4-7b45c597846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85467539-86e5-45eb-97cc-814358fa2f60', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39f78e-34fa-4c81-9207-3be4045f5c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:39 devstack sudo[87328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af 1073741824
Apr 09 10:43:39 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:39 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Volume volume-85467539-86e5-45eb-97cc-814358fa2f60 (85467539-86e5-45eb-97cc-814358fa2f60): created successfully
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39f78e-34fa-4c81-9207-3be4045f5c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (6adb8307-6b28-48cd-90d8-6fd02c4af330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:39 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6d50e115-4e17-45a3-8405-eb01f8a3e60d tempest-CreateVolumesFromImageTest-1739077905 None] Created volume successfully.
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "cinder-quobyte-8890e1b6-8164-4a19-9d11-a5133472cf19" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-8890e1b6-8164-4a19-9d11-a5133472cf19" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0c6617-ab3d-4f5d-81d3-0f9d516de96f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:39 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19
Apr 09 10:43:39 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:39 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:39 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:39 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af 1073741824" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:39 devstack sudo[87337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af
Apr 09 10:43:39 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:39 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19" returned: 0 in 0.520s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:39 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19
Apr 09 10:43:39 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:39 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.433s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:39 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:40 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af" returned: 0 in 0.458s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.677s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-117842167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60893a38-eaec-4024-8bbf-de1f199f7602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0878bcaecd304c018c30ce4b3987c7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:36Z,use_quota=True,user_id='f902bdd63ff44e44b0b8c9c5dac1cbb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Creating volume 60893a38-eaec-4024-8bbf-de1f199f7602 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:40 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f12df9-e72d-47d7-88d2-3cf1a3f5d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80eece-ebf7-4975-b75c-0a062fcfdcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:40 devstack sudo[87346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602 1073741824
Apr 09 10:43:40 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:40 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Volume volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af (7e3e9472-b627-4389-a8b9-7041c4ceb4af): created successfully
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80eece-ebf7-4975-b75c-0a062fcfdcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Flow 'volume_create_manager' (fc201375-2cc1-43a2-beec-842279d16eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-67466d21-836e-44df-815e-87fd5a8033b8 tempest-CreateVolumesFromImageTest-1739077905 None] Created volume successfully.
Apr 09 10:43:40 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8890e1b6-8164-4a19-9d11-a5133472cf19" returned: 0 in 0.426s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Lock "cinder-quobyte-8890e1b6-8164-4a19-9d11-a5133472cf19" released by "delete_volume" :: held 0.976s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Created reservations ['38325733-e1c7-4f1a-884a-7b6d2542e565'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:40 devstack cinder-volume[82783]: WARNING cinder.quota [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-671321513 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-671321513, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Created reservations ['118be9db-824d-40df-b53c-88428f5cd2bf', '1e464919-7b19-409f-b471-64b7c4cda31b', '5b788721-3c7a-420e-8def-7084925bd29c', 'c46ace1b-4cb5-4956-b1b4-1231c9b34443'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:40 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:40 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:40 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602 1073741824" returned: 0 in 0.521s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:40 devstack sudo[87354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602
Apr 09 10:43:40 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:40 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.459s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c17312c2-179c-485c-a470-66ad68ed575f tempest-GroupSnapshotsTest-927558645 None] Delete group completed successfully.
Apr 09 10:43:41 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602" returned: 0 in 0.416s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1296050683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a955055-e3a2-496e-8bbd-df8d5b21e8d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c554241594a6987aadf99593fd555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:39Z,use_quota=True,user_id='e317d912c76a49a7aabfc09b9267ccf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Creating volume 6a955055-e3a2-496e-8bbd-df8d5b21e8d2 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:41 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2a2a3e-4a1a-4efc-bfc7-b2bfbf68bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60893a38-eaec-4024-8bbf-de1f199f7602', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03085e2-b198-4549-9089-c5bf0b8a17f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:41 devstack sudo[87358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 1073741824
Apr 09 10:43:41 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:41 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Volume volume-60893a38-eaec-4024-8bbf-de1f199f7602 (60893a38-eaec-4024-8bbf-de1f199f7602): created successfully
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03085e2-b198-4549-9089-c5bf0b8a17f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Flow 'volume_create_manager' (dd73e6c5-ecb3-45e3-aa19-2719e30ff6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-be172393-369d-49e2-a534-95cb5cb40aa2 tempest-VolumesTransfersTest-537540930 None] Created volume successfully.
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-7e3e9472-b627-4389-a8b9-7041c4ceb4af-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-7e3e9472-b627-4389-a8b9-7041c4ceb4af-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-quobyte-7e3e9472-b627-4389-a8b9-7041c4ceb4af" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-7e3e9472-b627-4389-a8b9-7041c4ceb4af" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef124cd8-1cc3-447a-b532-1665bcd58b71]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:41 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af
Apr 09 10:43:41 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:41 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 1073741824" returned: 0 in 0.580s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:41 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2
Apr 09 10:43:41 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:41 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af" returned: 0 in 0.546s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:41 devstack sudo[87370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af
Apr 09 10:43:41 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Acquiring lock "cinder-60893a38-eaec-4024-8bbf-de1f199f7602-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-60893a38-eaec-4024-8bbf-de1f199f7602-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Acquiring lock "cinder-quobyte-60893a38-eaec-4024-8bbf-de1f199f7602" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-quobyte-60893a38-eaec-4024-8bbf-de1f199f7602" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3de29e8-3fd4-4d5d-b1be-ab933c0f204d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:42 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602
Apr 09 10:43:42 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:42 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2" returned: 0 in 0.600s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87b2820-a7d6-48f0-b9d5-05b2b34b378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5180e7fd-9d3d-4686-9866-2ca41e2ddda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:42 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Volume volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 (6a955055-e3a2-496e-8bbd-df8d5b21e8d2): created successfully
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5180e7fd-9d3d-4686-9866-2ca41e2ddda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Flow 'volume_create_manager' (9f84bcdf-0ada-4da8-b58a-eca12ce0fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:42 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-491980a5-b244-4d52-adef-cac75c55d313 req-a367661c-1fb2-4168-9b11-c679472adeda tempest-VolumesGetTestJSON-2059007776 None] Created volume successfully.
Apr 09 10:43:42 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-7e3e9472-b627-4389-a8b9-7041c4ceb4af" returned: 0 in 0.566s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-7e3e9472-b627-4389-a8b9-7041c4ceb4af" released by "delete_volume" :: held 1.134s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Created reservations ['3b409c24-89aa-487b-8097-b70832f4fa46', '3e71150f-80c3-4234-94f4-e9da1cd92c16', '298ab178-8bcc-45b2-8b34-8aa4e967d0ec', '60914835-1484-41c8-b9ad-6126eb32d4ad'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:42 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:42 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:42 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602" returned: 0 in 0.537s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:42 devstack sudo[87382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602
Apr 09 10:43:42 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:42 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.469s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:42 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Deleted volume successfully.
Apr 09 10:43:42 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-776cc6bb-a048-45f3-9670-519192838cb6 tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-7e3e9472-b627-4389-a8b9-7041c4ceb4af-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:43 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-60893a38-eaec-4024-8bbf-de1f199f7602" returned: 0 in 0.513s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-quobyte-60893a38-eaec-4024-8bbf-de1f199f7602" released by "delete_volume" :: held 1.071s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Created reservations ['51b3acbc-cdaa-4006-90d7-1b5bb4a12846', '5e07d739-afec-44ed-9bc8-7a8803d9d123', '113f77ea-03e8-422d-9a63-fa61e32a31d4', '9d400a32-d7c3-421f-ad10-a31235e64551'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:43 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:43 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Acquiring lock "cinder-6a955055-e3a2-496e-8bbd-df8d5b21e8d2-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Lock "cinder-6a955055-e3a2-496e-8bbd-df8d5b21e8d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Acquiring lock "cinder-quobyte-6a955055-e3a2-496e-8bbd-df8d5b21e8d2" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Lock "cinder-quobyte-6a955055-e3a2-496e-8bbd-df8d5b21e8d2" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3e464-3961-4584-9c92-816d7e3d7f33]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-85467539-86e5-45eb-97cc-814358fa2f60-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-85467539-86e5-45eb-97cc-814358fa2f60-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-quobyte-85467539-86e5-45eb-97cc-814358fa2f60" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-85467539-86e5-45eb-97cc-814358fa2f60" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d228232-7390-46ce-b6ed-5576198a382a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:43 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2
Apr 09 10:43:43 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:43 devstack sudo[87389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60
Apr 09 10:43:43 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:43 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:43 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Deleted volume successfully.
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e88c77b6-701f-4eea-a852-58ad4eaf0e68 tempest-VolumesTransfersTest-1043804699 None] Lock "cinder-60893a38-eaec-4024-8bbf-de1f199f7602-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:43 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2" returned: 0 in 0.588s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:43 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2
Apr 09 10:43:43 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:44 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60" returned: 0 in 0.583s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:44 devstack sudo[87401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60
Apr 09 10:43:44 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:44 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6a955055-e3a2-496e-8bbd-df8d5b21e8d2" returned: 0 in 0.497s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Lock "cinder-quobyte-6a955055-e3a2-496e-8bbd-df8d5b21e8d2" released by "delete_volume" :: held 1.123s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.quota [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Created reservations ['114102c3-a98d-44b7-883b-c468eddedac3', 'af023dd3-60a9-4efb-b514-f09e4c85f895', '0067a0f5-56bc-4239-b9d1-6c77f001cc4d', 'e3f4c99c-b2dd-41dc-9729-ab1fc230bf34'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:44 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:44 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:44 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85467539-86e5-45eb-97cc-814358fa2f60" returned: 0 in 0.563s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-85467539-86e5-45eb-97cc-814358fa2f60" released by "delete_volume" :: held 1.186s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Created reservations ['3a68f857-87b7-4ce4-a341-d379f9564515', '3f492269-6f9b-450b-a277-e2e15b4a240e', '8143a385-7041-4722-a0ee-079261cac1d0', 'e917da1a-0992-4811-8b33-5c7467bc24d5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:44 devstack sudo[87408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:44 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:45 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6d4be560-34b6-425a-9f12-df2b1f0fbffb tempest-GroupsV314Test-2101067013 None] Group tempest-GroupsV314Test-Group-100268933: creating
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.633s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.manager [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Deleted volume successfully.
Apr 09 10:43:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6d4be560-34b6-425a-9f12-df2b1f0fbffb tempest-GroupsV314Test-2101067013 None] Group tempest-GroupsV314Test-Group-100268933: created successfully
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [req-1e8d66e3-8584-4064-9457-50690f728292 req-87020454-e3d1-4d0a-9607-6d0b39175afc tempest-VolumesGetTestJSON-2059007776 None] Lock "cinder-6a955055-e3a2-496e-8bbd-df8d5b21e8d2-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6d4be560-34b6-425a-9f12-df2b1f0fbffb tempest-GroupsV314Test-2101067013 None] Create group completed successfully.
Apr 09 10:43:45 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Deleted volume successfully.
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74195aeb-405c-4139-9606-e8736ccbba8f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-85467539-86e5-45eb-97cc-814358fa2f60-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-quobyte-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939" acquired by "delete_volume" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e6ef47-493f-4058-9b87-884f55cd2b79]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:45 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939
Apr 09 10:43:45 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:46 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939" returned: 0 in 0.777s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:46 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939
Apr 09 10:43:46 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Flow 'volume_create_manager' (b6453360-068e-4769-9680-3f5638e8c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3efef23-5440-4ef8-a79c-f7d44ec717ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3efef23-5440-4ef8-a79c-f7d44ec717ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-970121027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f893a942-aa51-4ef7-aabd-25cc6ebe6a1e,host='devstack@QuobyteHD#QuobyteHD',id=634fa8ae-16dc-4a10-b604-acc2ba9cf18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffd0e39378496d89c28c671e22ef2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:46Z,use_quota=True,user_id='93f2f4bd20e44dda816dbc4c47ee453a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c517a427-b965-4ed0-80d9-06ac3853d716),volume_type_id=c517a427-b965-4ed0-80d9-06ac3853d716)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b31b03-1cb7-4e3c-a7bb-10f5b86c8a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b31b03-1cb7-4e3c-a7bb-10f5b86c8a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c32b9a6-22f2-4722-9aa8-9ccdd9b0ffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c32b9a6-22f2-4722-9aa8-9ccdd9b0ffdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '634fa8ae-16dc-4a10-b604-acc2ba9cf18c', 'volume_name': 'volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54240a59-eb75-471a-836f-5e776fb7e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54240a59-eb75-471a-836f-5e776fb7e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b5cf1b-73c9-4c0f-afc3-e553e6eaa5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:46 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Volume 634fa8ae-16dc-4a10-b604-acc2ba9cf18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c', 'volume_size': 1}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f893a942-aa51-4ef7-aabd-25cc6ebe6a1e,created_at=2026-04-09T08:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-970121027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f893a942-aa51-4ef7-aabd-25cc6ebe6a1e,host='devstack@QuobyteHD#QuobyteHD',id=634fa8ae-16dc-4a10-b604-acc2ba9cf18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffd0e39378496d89c28c671e22ef2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:46Z,use_quota=True,user_id='93f2f4bd20e44dda816dbc4c47ee453a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c517a427-b965-4ed0-80d9-06ac3853d716),volume_type_id=c517a427-b965-4ed0-80d9-06ac3853d716)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Creating volume 634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:46 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:46 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c 1073741824
Apr 09 10:43:46 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:46 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939" returned: 0 in 0.538s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939" released by "delete_volume" :: held 1.346s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Created reservations ['5db0eae1-6efd-4064-9c87-ca6574036b01', '9f81ab01-75ea-483d-8910-3a3cfff4212e', 'c4f2e157-2d0e-4631-be74-d7538da82a27', 'ee239fe9-4fb9-48e7-942e-e176b360b1c3'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:47 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:47 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:47 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c 1073741824" returned: 0 in 0.639s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:47 devstack sudo[87433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:43:47 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:47 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.597s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:47 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Deleted volume successfully.
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9a3a24ce-7cad-4b6e-ad46-14617e1dafde tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-3c92c8e9-ba9b-4668-b66e-f2cdb8acc939-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-d26492a9-660d-48d4-8091-deb7d805edec-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-d26492a9-660d-48d4-8091-deb7d805edec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-quobyte-d26492a9-660d-48d4-8091-deb7d805edec" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-d26492a9-660d-48d4-8091-deb7d805edec" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:47 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.631s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bd3f81-9d60-4646-bcc3-4e324c797602]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b5cf1b-73c9-4c0f-afc3-e553e6eaa5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce3279-2430-4ad5-a426-1dc3fe6532c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Flow 'volume_create_manager' (87fc5479-8125-4fa4-ac8f-a05c033b6eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7153b60b-1ab1-4bb0-a382-8428fa757435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:47 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec
Apr 09 10:43:47 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7153b60b-1ab1-4bb0-a382-8428fa757435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-14170505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefdce02-aa10-4a31-8ea1-96c54e17680e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6819059801bd406dba20d154b6d94689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:48Z,use_quota=True,user_id='a60660f48f824688bb8967d691eabe6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e91ff95-0c45-4f45-807e-29354b2bf298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e91ff95-0c45-4f45-807e-29354b2bf298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bcf688-4df5-4bf9-93e5-d7c05dd4cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bcf688-4df5-4bf9-93e5-d7c05dd4cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cefdce02-aa10-4a31-8ea1-96c54e17680e', 'volume_name': 'volume-cefdce02-aa10-4a31-8ea1-96c54e17680e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f55b085-beb5-4786-aaed-5951ca437c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f55b085-beb5-4786-aaed-5951ca437c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb9fc9d-fea6-4228-a56b-989722299147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:48 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Volume cefdce02-aa10-4a31-8ea1-96c54e17680e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cefdce02-aa10-4a31-8ea1-96c54e17680e', 'volume_size': 1}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-14170505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefdce02-aa10-4a31-8ea1-96c54e17680e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6819059801bd406dba20d154b6d94689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:48Z,use_quota=True,user_id='a60660f48f824688bb8967d691eabe6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Creating volume cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:43:48 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:48 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Volume volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c (634fa8ae-16dc-4a10-b604-acc2ba9cf18c): created successfully
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce3279-2430-4ad5-a426-1dc3fe6532c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Flow 'volume_create_manager' (b6453360-068e-4769-9680-3f5638e8c26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:48 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e 1073741824
Apr 09 10:43:48 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-856ceb26-5dd1-4f68-9d56-782349ba240d tempest-GroupsV314Test-2101067013 None] Created volume successfully.
Apr 09 10:43:48 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec" returned: 0 in 0.556s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:48 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec
Apr 09 10:43:48 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:48 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e 1073741824" returned: 0 in 0.598s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:48 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:43:48 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:48 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d26492a9-660d-48d4-8091-deb7d805edec" returned: 0 in 0.520s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-d26492a9-660d-48d4-8091-deb7d805edec" released by "delete_volume" :: held 1.106s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Created reservations ['9cee096e-086d-4227-87a0-d50a107cfac2', 'adfd67ca-beb6-4717-8c80-bd6c273e45d9', '9b778228-865a-455f-9e6e-65963aed68de', '44dbd97f-bea0-48dc-a4b8-56fe06b4970f'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:49 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:49 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:49 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.486s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb9fc9d-fea6-4228-a56b-989722299147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cefdce02-aa10-4a31-8ea1-96c54e17680e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51391158-8a5b-4637-9586-72bc8049b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:49 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Volume volume-cefdce02-aa10-4a31-8ea1-96c54e17680e (cefdce02-aa10-4a31-8ea1-96c54e17680e): created successfully
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51391158-8a5b-4637-9586-72bc8049b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Flow 'volume_create_manager' (87fc5479-8125-4fa4-ac8f-a05c033b6eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8d52529b-6969-4830-834b-1bad7d4844be tempest-VolumesCloneTest-1457724698 None] Created volume successfully.
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:49 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Cloning volume 634fa8ae-16dc-4a10-b604-acc2ba9cf18c to volume 01eae7dc-d755-4426-83a1-1af8246fb7b4
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Creating offline snapshot 2529c782-60be-44e4-bbc0-6a4fdad2c9c1 of volume 634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27fb4c0-8c93-4993-b76a-8a6032a8b0a9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:49 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.544s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Deleted volume successfully.
Apr 09 10:43:49 devstack sudo[87490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:43:49 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ab5fd61c-3c74-435f-ac8e-066c221c4a4f tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-d26492a9-660d-48d4-8091-deb7d805edec-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-3ab502f1-2821-4085-9a1f-6cad218f5e7d-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-3ab502f1-2821-4085-9a1f-6cad218f5e7d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "cinder-quobyte-3ab502f1-2821-4085-9a1f-6cad218f5e7d" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-3ab502f1-2821-4085-9a1f-6cad218f5e7d" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[681738a9-3470-4585-b332-40d07b3849d4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:50 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.592s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:50 devstack sudo[87496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 1G
Apr 09 10:43:50 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:50 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d
Apr 09 10:43:50 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Flow 'volume_create_manager' (db3ae7ab-9a05-4a72-ac88-9a2f7fe83b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323cf518-3d91-4594-90fa-75c0340ed2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323cf518-3d91-4594-90fa-75c0340ed2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1153787869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85db9d07-35ac-47ae-83d8-91abfe12eb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6819059801bd406dba20d154b6d94689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=cefdce02-aa10-4a31-8ea1-96c54e17680e,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:50Z,use_quota=True,user_id='a60660f48f824688bb8967d691eabe6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793cfab-c2dd-41ec-abc2-5a7ea3571d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793cfab-c2dd-41ec-abc2-5a7ea3571d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5235f594-3ee9-4cb6-93f5-2260f76e039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5235f594-3ee9-4cb6-93f5-2260f76e039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85db9d07-35ac-47ae-83d8-91abfe12eb0d', 'volume_name': 'volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d', 'volume_size': 2, 'source_volid': 'cefdce02-aa10-4a31-8ea1-96c54e17680e', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d73e161-0db5-43f3-b2d6-7aacbeb4063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d73e161-0db5-43f3-b2d6-7aacbeb4063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cbfbc7-72c9-4fb3-8bee-3ae4e620ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:50 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Volume 85db9d07-35ac-47ae-83d8-91abfe12eb0d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d', 'volume_size': 2, 'source_volid': 'cefdce02-aa10-4a31-8ea1-96c54e17680e', 'source_volstatus': 'available'}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:50 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:50 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 1G" returned: 0 in 0.591s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:50 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d
Apr 09 10:43:50 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:50 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1
Apr 09 10:43:50 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:51 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3ab502f1-2821-4085-9a1f-6cad218f5e7d" returned: 0 in 0.412s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-quobyte-3ab502f1-2821-4085-9a1f-6cad218f5e7d" released by "delete_volume" :: held 1.041s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:51 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1" returned: 0 in 0.445s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:51 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:51 devstack sudo[87513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Created reservations ['f7bfa9fe-a7b2-487a-93a1-f2b6d810a0e1', '7a6744ac-1690-4fef-a4b8-365c20d4b63a', '9af98905-1750-4dcf-983c-56fe497f683f', '13c8e41a-b0ef-42c8-8aeb-31e783d5be62'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:43:51 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:51 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:43:51 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:51 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1" returned: 0 in 0.410s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:51 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info
Apr 09 10:43:51 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:51 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.423s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eb7c3673-076f-4ca8-988b-bf720ab38a7e tempest-BackendsCapabilitiesAdminTestsJSON-316427581 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 09 10:43:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Deleted volume successfully.
Apr 09 10:43:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1334f764-6b24-4941-b6d7-42859871e51b tempest-CreateVolumesFromImageTest-1739077905 None] Lock "cinder-3ab502f1-2821-4085-9a1f-6cad218f5e7d-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:52 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info" returned: 0 in 0.434s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:52 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:52 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info
Apr 09 10:43:52 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b9337931-aba5-4919-946a-13ed6c001d76 tempest-BackendsCapabilitiesAdminTestsJSON-316427581 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 09 10:43:52 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.info" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Acquiring lock "cinder-quobyte-01eae7dc-d755-4426-83a1-1af8246fb7b4" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-01eae7dc-d755-4426-83a1-1af8246fb7b4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] snapshot: 2529c782-60be-44e4-bbc0-6a4fdad2c9c1, volume: 01eae7dc-d755-4426-83a1-1af8246fb7b4,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741bc00-646f-433b-be29-3cb375a305a2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:52 devstack sudo[87526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1
Apr 09 10:43:52 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:53 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1" returned: 0 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aa421e-ba98-4b42-bffe-efbe74b0666d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:53 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:43:53 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:53 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:43:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:53 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4
Apr 09 10:43:53 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Flow 'volume_create_manager' (fdaba66b-5c98-4c57-b69e-a9c6fa3f7f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6f5c48-9e95-42a9-99d6-219364faea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6f5c48-9e95-42a9-99d6-219364faea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d35b52a-8f9a-43a0-9911-e551d742bee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f22a128a934466d828a85f58fb22eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:54Z,use_quota=True,user_id='7bb9256ef0944f519fb1f090db9d485f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1528b292-5f63-4313-bff5-a5ab15d680b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1528b292-5f63-4313-bff5-a5ab15d680b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c69f4a-a607-422b-a592-b7bcee204790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c69f4a-a607-422b-a592-b7bcee204790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d35b52a-8f9a-43a0-9911-e551d742bee4', 'volume_name': 'volume-2d35b52a-8f9a-43a0-9911-e551d742bee4', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9a3dd8-ec8a-4e89-87e8-5725d05e6853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9a3dd8-ec8a-4e89-87e8-5725d05e6853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae955d2-67e3-4d52-9f92-c1a8f073b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:43:54 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Volume 2d35b52a-8f9a-43a0-9911-e551d742bee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d35b52a-8f9a-43a0-9911-e551d742bee4', 'volume_size': 1}
Apr 09 10:43:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:43:55 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4" returned: 0 in 2.323s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:55 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6809f18c-5050-467f-a9a0-67da8c0ae348]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:56 devstack sudo[87549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:43:56 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:56 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.673s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:56 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:43:56 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Converted 1024.00 MB image at 440.71 MB/s
Apr 09 10:43:56 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 10:43:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:56 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4
Apr 09 10:43:56 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:57 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-01eae7dc-d755-4426-83a1-1af8246fb7b4" released by "_copy_volume_from_snapshot" :: held 4.617s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Acquiring lock "cinder-quobyte-2529c782-60be-44e4-bbc0-6a4fdad2c9c1" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-2529c782-60be-44e4-bbc0-6a4fdad2c9c1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Deleting offline snapshot 2529c782-60be-44e4-bbc0-6a4fdad2c9c1 of volume 634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] snapshot_file for this snap is: volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556fed5-5bc9-4ade-97fe-1e712129a4e7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:57 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1
Apr 09 10:43:57 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:57 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1" returned: 0 in 0.572s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bac575-1766-4c8c-b2fc-d3729eabca38]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:57 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:43:57 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:58 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.556s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:58 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1
Apr 09 10:43:58 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:58 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:58 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1
Apr 09 10:43:58 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:59 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c.2529c782-60be-44e4-bbc0-6a4fdad2c9c1" returned: 0 in 0.440s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-2529c782-60be-44e4-bbc0-6a4fdad2c9c1" released by "_delete_snapshot" :: held 2.139s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.788s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.860s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:43:59 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Cloning volume cefdce02-aa10-4a31-8ea1-96c54e17680e to volume 85db9d07-35ac-47ae-83d8-91abfe12eb0d
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Creating offline snapshot a87bb223-baf9-4843-aea5-731e8628e83a of volume cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb386e6-d1db-43d7-ae5c-e34547f937ef]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-cfc53f32-51b1-4d8c-b1bc-c8dda1ad09c0 tempest-GroupsV314Test-2101067013 None] Create group from source-group-f893a942-aa51-4ef7-aabd-25cc6ebe6a1e completed successfully.
Apr 09 10:43:59 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:43:59 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:43:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1e928930-f5e8-45b6-a472-eaf826a9454a tempest-GroupsV320Test-1298673194 None] Group tempest-GroupsV320Test-Group-82917322: creating
Apr 09 10:43:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1e928930-f5e8-45b6-a472-eaf826a9454a tempest-GroupsV320Test-1298673194 None] Group tempest-GroupsV320Test-Group-82917322: created successfully
Apr 09 10:43:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1e928930-f5e8-45b6-a472-eaf826a9454a tempest-GroupsV320Test-1298673194 None] Create group completed successfully.
Apr 09 10:43:59 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:43:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:43:59 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a 1G
Apr 09 10:43:59 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:00 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a 1G" returned: 0 in 0.461s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefdce02-aa10-4a31-8ea1-96c54e17680e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:00 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefdce02-aa10-4a31-8ea1-96c54e17680e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a
Apr 09 10:44:00 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Acquiring lock "cinder-quobyte-01eae7dc-d755-4426-83a1-1af8246fb7b4" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-01eae7dc-d755-4426-83a1-1af8246fb7b4" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f4a2c-74a4-421c-ace4-79ed297e86f4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:00 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4
Apr 09 10:44:00 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:00 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefdce02-aa10-4a31-8ea1-96c54e17680e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:00 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a is being set with open permissions: ugo+rw
Apr 09 10:44:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:00 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a
Apr 09 10:44:00 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Created reservations ['d77147e9-51b6-4e35-baf3-04d5173489c5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:01 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:01 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:01 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4" returned: 0 in 0.572s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:01 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4
Apr 09 10:44:01 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:01 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:01 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info
Apr 09 10:44:01 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:01 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.425s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:01 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5f5d8a20-f0a4-4931-89c9-304d210be747 tempest-GroupsV320Test-1298673194 None] Delete group completed successfully.
Apr 09 10:44:01 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-01eae7dc-d755-4426-83a1-1af8246fb7b4" returned: 0 in 0.448s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-01eae7dc-d755-4426-83a1-1af8246fb7b4" released by "delete_volume" :: held 1.044s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Created reservations ['1f7f17f9-3da3-4398-bb4d-31f597071277'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:01 devstack cinder-volume[82783]: WARNING cinder.quota [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-269046852 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-269046852, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:44:01 devstack cinder-volume[82783]: WARNING cinder.quota [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-269046852 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-269046852, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Created reservations ['2d097a33-43d5-4987-95db-3af3428ad94f', '42db8e07-7342-401c-92f3-63e9430bb7b0', '6c1e4b45-354d-49b0-b6f3-f0caefff3e93', 'a6bbb05d-a026-487f-9871-9dba49429988'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:01 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info" returned: 0 in 0.416s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:01 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info is being set with open permissions: ugo+rw
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:01 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info
Apr 09 10:44:01 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:01 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:01 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:02 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.info" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Acquiring lock "cinder-quobyte-85db9d07-35ac-47ae-83d8-91abfe12eb0d" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-85db9d07-35ac-47ae-83d8-91abfe12eb0d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] snapshot: a87bb223-baf9-4843-aea5-731e8628e83a, volume: 85db9d07-35ac-47ae-83d8-91abfe12eb0d,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a02dcc-ed42-4988-a2a3-b29428f582fd]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:02 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.452s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2392902c-7a36-4596-bc94-1e1471bf8bb1 tempest-GroupsV314Test-2101067013 None] Delete group completed successfully.
Apr 09 10:44:02 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a
Apr 09 10:44:02 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:02 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a" returned: 0 in 0.559s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefdce02-aa10-4a31-8ea1-96c54e17680e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7119a57-3bb3-4ee2-bfe6-8379d1ea31ba]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:02 devstack sudo[87619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:44:02 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Acquiring lock "cinder-quobyte-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a03d7d-a257-414b-89a3-938b51a760fd]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:03 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:44:03 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:03 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.612s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:03 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:44:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:03 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d
Apr 09 10:44:03 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:03 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.607s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:03 devstack sudo[87633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c
Apr 09 10:44:03 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:04 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" returned: 0 in 0.719s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Lock "cinder-quobyte-634fa8ae-16dc-4a10-b604-acc2ba9cf18c" released by "delete_volume" :: held 1.389s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Created reservations ['4a5d670a-350f-4d23-b32d-3684f7508f08'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Created reservations ['5c34e9f7-749f-4c8b-985e-98b67e17bea5', '3f3b8a45-d212-4d33-b8e4-daf11c58a494', 'b2060cea-1006-49b6-8b17-d6f667959c0f', '1581df39-5a15-417d-a33b-c5e9364a45bd'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:05 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:05 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:05 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d" returned: 0 in 2.404s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:05 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abf83c7-63e5-4255-aff0-4d485c142778]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:05 devstack sudo[87650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:44:05 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:05 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 1.004s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:06 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f2aad548-6b5d-4fb6-97b7-0afa619746ba tempest-GroupsV314Test-2101067013 None] Delete group completed successfully.
Apr 09 10:44:06 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.724s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:44:06 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Converted 1024.00 MB image at 425.64 MB/s
Apr 09 10:44:06 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d is being set with open permissions: ugo+rw
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:06 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d
Apr 09 10:44:06 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:06 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-85db9d07-35ac-47ae-83d8-91abfe12eb0d" released by "_copy_volume_from_snapshot" :: held 4.837s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Acquiring lock "cinder-quobyte-a87bb223-baf9-4843-aea5-731e8628e83a" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-a87bb223-baf9-4843-aea5-731e8628e83a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Deleting offline snapshot a87bb223-baf9-4843-aea5-731e8628e83a of volume cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] snapshot_file for this snap is: volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[536330cb-bc3c-4f09-a2ed-e538eefff98c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:07 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a
Apr 09 10:44:07 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:07 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a" returned: 0 in 0.547s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefdce02-aa10-4a31-8ea1-96c54e17680e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c51abb-c2cc-4d54-b211-394fe089e963]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:07 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:44:07 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:08 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.589s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:08 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a
Apr 09 10:44:08 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:08 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a" returned: 0 in 0.528s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:08 devstack sudo[87674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a
Apr 09 10:44:08 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:09 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e.a87bb223-baf9-4843-aea5-731e8628e83a" returned: 0 in 0.497s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-a87bb223-baf9-4843-aea5-731e8628e83a" released by "_delete_snapshot" :: held 2.209s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.972s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.112s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d35b52a-8f9a-43a0-9911-e551d742bee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f22a128a934466d828a85f58fb22eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:43:54Z,use_quota=True,user_id='7bb9256ef0944f519fb1f090db9d485f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Creating volume 2d35b52a-8f9a-43a0-9911-e551d742bee4 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:09 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cbfbc7-72c9-4fb3-8bee-3ae4e620ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d', 'volume_size': 2, 'source_volid': 'cefdce02-aa10-4a31-8ea1-96c54e17680e', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7515c-4281-4ca2-a157-7f7e7fa8cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:09 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Volume volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d (85db9d07-35ac-47ae-83d8-91abfe12eb0d): created successfully
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7515c-4281-4ca2-a157-7f7e7fa8cd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:09 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 1073741824
Apr 09 10:44:09 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Flow 'volume_create_manager' (db3ae7ab-9a05-4a72-ac88-9a2f7fe83b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:09 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f17ca30b-3419-466e-8a7b-25e28900e99b tempest-VolumesCloneTest-1457724698 None] Created volume successfully.
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Acquiring lock "cinder-85db9d07-35ac-47ae-83d8-91abfe12eb0d-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-85db9d07-35ac-47ae-83d8-91abfe12eb0d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Acquiring lock "cinder-quobyte-85db9d07-35ac-47ae-83d8-91abfe12eb0d" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-85db9d07-35ac-47ae-83d8-91abfe12eb0d" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eb7d7d-c4c4-4c73-8c6c-bd755a6df61b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:09 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d
Apr 09 10:44:09 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:09 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 1073741824" returned: 0 in 0.608s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:09 devstack sudo[87684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4
Apr 09 10:44:09 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:10 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d" returned: 0 in 0.586s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:10 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d
Apr 09 10:44:10 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:10 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae955d2-67e3-4d52-9f92-c1a8f073b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d35b52a-8f9a-43a0-9911-e551d742bee4', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fe412d-e797-45ea-9dfc-5885052d954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:10 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Volume volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 (2d35b52a-8f9a-43a0-9911-e551d742bee4): created successfully
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fe412d-e797-45ea-9dfc-5885052d954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Flow 'volume_create_manager' (fdaba66b-5c98-4c57-b69e-a9c6fa3f7f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:10 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f8e97d51-68ae-425e-9b42-cb7b07756143 tempest-CinderUnicodeTest-991824396 None] Created volume successfully.
Apr 09 10:44:10 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db9d07-35ac-47ae-83d8-91abfe12eb0d" returned: 0 in 0.580s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-85db9d07-35ac-47ae-83d8-91abfe12eb0d" released by "delete_volume" :: held 1.207s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Created reservations ['13cc34f6-b2bd-4c98-be2a-ec37f71c5397', '9cbb503c-f586-4287-a612-a80dbaae0bec', '89d93801-51a0-46ea-b4b9-a69db7ce7725', 'f0aa8872-523d-492d-971b-daa1731bb0e2'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:10 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:10 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:11 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.480s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Deleted volume successfully.
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-01da09e1-0bfe-412b-8862-aa1926cf59e3 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-85db9d07-35ac-47ae-83d8-91abfe12eb0d-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Flow 'volume_create_manager' (6e6adafa-f59f-4049-a7ae-026c68934610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1199b8a-f69b-4df7-afa5-8b755e4ee3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1199b8a-f69b-4df7-afa5-8b755e4ee3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086013157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7a4618-fa00-4636-bc06-0dc231b2e11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f22a128a934466d828a85f58fb22eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:11Z,use_quota=True,user_id='7bb9256ef0944f519fb1f090db9d485f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46035590-b056-4bf4-b399-f45b1b981f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46035590-b056-4bf4-b399-f45b1b981f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00af0f4e-0c6e-4251-ab6a-9aaadb50c18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00af0f4e-0c6e-4251-ab6a-9aaadb50c18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7a4618-fa00-4636-bc06-0dc231b2e11b', 'volume_name': 'volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21e13b5-d8d2-48c0-803a-0a0140d4419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21e13b5-d8d2-48c0-803a-0a0140d4419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107cdcb2-ce11-44b9-a126-1ddac7039ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Volume 3b7a4618-fa00-4636-bc06-0dc231b2e11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b', 'volume_size': 1}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086013157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7a4618-fa00-4636-bc06-0dc231b2e11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f22a128a934466d828a85f58fb22eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:11Z,use_quota=True,user_id='7bb9256ef0944f519fb1f090db9d485f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Creating volume 3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:11 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:11 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b 1073741824
Apr 09 10:44:11 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Flow 'volume_create_manager' (239b8eb2-2708-4485-b242-323123463c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08ac6a5-6974-45a1-9347-0612f7c6fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08ac6a5-6974-45a1-9347-0612f7c6fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1799133768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea769158-1b8d-43cf-b723-ea116e98d42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d4335bbea947f690c93ed8012a9b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:12Z,use_quota=True,user_id='1efd20a2f36c40979392f662967f7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9190b29-425c-48b0-8fd4-18b3631b1cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9190b29-425c-48b0-8fd4-18b3631b1cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885495a5-bf22-4ab8-8fff-034e009d1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885495a5-bf22-4ab8-8fff-034e009d1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea769158-1b8d-43cf-b723-ea116e98d42c', 'volume_name': 'volume-ea769158-1b8d-43cf-b723-ea116e98d42c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d330d59d-cf25-4f92-8e23-65740743edd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d330d59d-cf25-4f92-8e23-65740743edd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0845a7-2459-441d-ae96-b9377e6473fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Volume ea769158-1b8d-43cf-b723-ea116e98d42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea769158-1b8d-43cf-b723-ea116e98d42c', 'volume_size': 1}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Acquiring lock "cinder-cefdce02-aa10-4a31-8ea1-96c54e17680e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-cefdce02-aa10-4a31-8ea1-96c54e17680e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Acquiring lock "cinder-quobyte-cefdce02-aa10-4a31-8ea1-96c54e17680e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-cefdce02-aa10-4a31-8ea1-96c54e17680e" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3603eec7-2e7f-41ca-a384-83e62bbe4f7c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:11 devstack sudo[87698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:44:11 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:12 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b 1073741824" returned: 0 in 0.601s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:12 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b
Apr 09 10:44:12 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:12 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.589s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:12 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e
Apr 09 10:44:12 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:12 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1799133768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea769158-1b8d-43cf-b723-ea116e98d42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d4335bbea947f690c93ed8012a9b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:12Z,use_quota=True,user_id='1efd20a2f36c40979392f662967f7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Creating volume ea769158-1b8d-43cf-b723-ea116e98d42c {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:12 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107cdcb2-ce11-44b9-a126-1ddac7039ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284108f6-15e7-4a6e-a61d-0f179de91157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:12 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c 1073741824
Apr 09 10:44:12 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:12 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Volume volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b (3b7a4618-fa00-4636-bc06-0dc231b2e11b): created successfully
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284108f6-15e7-4a6e-a61d-0f179de91157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Flow 'volume_create_manager' (6e6adafa-f59f-4049-a7ae-026c68934610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e9e4c527-4c5a-4406-98a6-ecc68b544f7a tempest-CinderUnicodeTest-991824396 None] Created volume successfully.
Apr 09 10:44:12 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-cefdce02-aa10-4a31-8ea1-96c54e17680e" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-quobyte-cefdce02-aa10-4a31-8ea1-96c54e17680e" released by "delete_volume" :: held 1.135s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Created reservations ['5165734b-ea01-4c2b-a6f2-2e7e8d19d842', '13825c10-ac4f-4242-bea2-33a32f4dfae6', '8155af9c-5b10-4200-abc7-18d13d4e679f', 'd2cfcb4b-b7dd-4db2-b166-4a87574f3fae'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:13 devstack sudo[87718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:13 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:13 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c 1073741824" returned: 0 in 0.623s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:13 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c
Apr 09 10:44:13 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:13 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.511s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Deleted volume successfully.
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e66bc8d9-c3c5-4534-a1ff-9f4690f52479 tempest-VolumesCloneTest-1457724698 None] Lock "cinder-cefdce02-aa10-4a31-8ea1-96c54e17680e-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:13 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c" returned: 0 in 0.554s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.058s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0845a7-2459-441d-ae96-b9377e6473fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea769158-1b8d-43cf-b723-ea116e98d42c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518e1932-38a5-475f-a31b-f3f0247cd983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:13 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Volume volume-ea769158-1b8d-43cf-b723-ea116e98d42c (ea769158-1b8d-43cf-b723-ea116e98d42c): created successfully
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518e1932-38a5-475f-a31b-f3f0247cd983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Flow 'volume_create_manager' (239b8eb2-2708-4485-b242-323123463c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Creating offline snapshot 6523de1a-24bb-4f2d-814d-bb2c51f68689 of volume 3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-18effdb0-f78f-4beb-9147-608528d4d288 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Created volume successfully.
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5309b6-6263-468d-920d-da9778609151]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:13 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b
Apr 09 10:44:13 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:14 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b" returned: 0 in 0.617s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:14 devstack sudo[87729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 1G
Apr 09 10:44:14 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "cinder-ea769158-1b8d-43cf-b723-ea116e98d42c-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "cinder-ea769158-1b8d-43cf-b723-ea116e98d42c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "cinder-quobyte-ea769158-1b8d-43cf-b723-ea116e98d42c" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "cinder-quobyte-ea769158-1b8d-43cf-b723-ea116e98d42c" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db1353-0eaf-4ead-88ef-dc63e4dae908]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:15 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 1G" returned: 0 in 0.610s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:15 devstack sudo[87735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689
Apr 09 10:44:15 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:15 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c
Apr 09 10:44:15 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:15 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689" returned: 0 in 0.559s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:15 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 is being set with open permissions: ugo+rw
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:15 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689
Apr 09 10:44:15 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:15 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c" returned: 0 in 0.647s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:15 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c
Apr 09 10:44:15 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:16 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:16 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info
Apr 09 10:44:16 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Flow 'volume_create_manager' (2adce7df-b4ef-4dc6-87a3-c0526e955abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60d8b2e-c649-4b7e-850b-5ecef9cb7354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:16 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ea769158-1b8d-43cf-b723-ea116e98d42c" returned: 0 in 0.536s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60d8b2e-c649-4b7e-850b-5ecef9cb7354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1199229688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c68631-2cf8-4297-a1d3-4c7b1be54f9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9ade1a46c7942cfb79858adf2972f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:16Z,use_quota=True,user_id='e3d48b1fc7524105b4e27b483b352cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fc9209-bffb-4908-8491-45fa99e7779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fc9209-bffb-4908-8491-45fa99e7779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f1ab9-b874-4761-b495-4483c112ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f1ab9-b874-4761-b495-4483c112ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c68631-2cf8-4297-a1d3-4c7b1be54f9a', 'volume_name': 'volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabec638-ea62-4680-90f3-136c184f76fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabec638-ea62-4680-90f3-136c184f76fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dc23f8-95a6-446e-91c8-a4b08cf59f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:16 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Volume f1c68631-2cf8-4297-a1d3-4c7b1be54f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a', 'volume_size': 1}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "cinder-quobyte-ea769158-1b8d-43cf-b723-ea116e98d42c" released by "delete_volume" :: held 1.256s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Created reservations ['fcd00bd9-90aa-49f3-8cc7-cc5bee53bd7a', '50d6cf3e-0bd5-4712-ad28-2cb7948abd96', '1b976274-4b4b-47ae-8e43-d4d06e8d90d6', 'bee3973d-6c28-4fa4-8faf-1ec1bf1378f9'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:16 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:16 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:16 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:16 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info is being set with open permissions: ugo+rw
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:16 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info
Apr 09 10:44:16 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:16 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Deleted volume successfully.
Apr 09 10:44:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22fdaf17-35ad-4a7d-8a76-d4205262ae00 tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "cinder-ea769158-1b8d-43cf-b723-ea116e98d42c-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:17 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.info" returned: 0 in 0.452s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1199229688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c68631-2cf8-4297-a1d3-4c7b1be54f9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9ade1a46c7942cfb79858adf2972f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:16Z,use_quota=True,user_id='e3d48b1fc7524105b4e27b483b352cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Creating volume f1c68631-2cf8-4297-a1d3-4c7b1be54f9a {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:17 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e28346ae-fb8b-4719-a609-613d7e81b9cf tempest-CinderUnicodeTest-991824396 None] Create snapshot completed successfully
Apr 09 10:44:17 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a 1073741824
Apr 09 10:44:17 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Flow 'volume_create_manager' (b0e796f1-c707-45c5-82ff-299eddb7fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ee1099-f9ed-4928-bddb-baae9f78c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ee1099-f9ed-4928-bddb-baae9f78c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1423484035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd26b34-6f3b-4f99-8b23-0eaf0849d335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d4335bbea947f690c93ed8012a9b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:17Z,use_quota=True,user_id='1efd20a2f36c40979392f662967f7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfcedbc-ddb7-419c-bcdc-10f0c22a4526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfcedbc-ddb7-419c-bcdc-10f0c22a4526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4313ac6e-7d32-4f8d-a133-72539352e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4313ac6e-7d32-4f8d-a133-72539352e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd26b34-6f3b-4f99-8b23-0eaf0849d335', 'volume_name': 'volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368a1caf-62ae-4557-b05d-c9af05ca7825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368a1caf-62ae-4557-b05d-c9af05ca7825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172da7d-9c46-4bfd-8bf9-d08142b0ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:17 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Volume 2fd26b34-6f3b-4f99-8b23-0eaf0849d335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335', 'volume_size': 1}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:17 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a 1073741824" returned: 0 in 0.588s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:17 devstack sudo[87764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a
Apr 09 10:44:17 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-6523de1a-24bb-4f2d-814d-bb2c51f68689-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-6523de1a-24bb-4f2d-814d-bb2c51f68689-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-quobyte-3b7a4618-fa00-4636-bc06-0dc231b2e11b" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-3b7a4618-fa00-4636-bc06-0dc231b2e11b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-quobyte-6523de1a-24bb-4f2d-814d-bb2c51f68689" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-6523de1a-24bb-4f2d-814d-bb2c51f68689" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Deleting offline snapshot 6523de1a-24bb-4f2d-814d-bb2c51f68689 of volume 3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] snapshot_file for this snap is: volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e5a83-6be4-4b32-a212-949968ecf3ee]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:18 devstack sudo[87766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689
Apr 09 10:44:18 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:18 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a" returned: 0 in 0.444s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1423484035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd26b34-6f3b-4f99-8b23-0eaf0849d335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d4335bbea947f690c93ed8012a9b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:17Z,use_quota=True,user_id='1efd20a2f36c40979392f662967f7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Creating volume 2fd26b34-6f3b-4f99-8b23-0eaf0849d335 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:18 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dc23f8-95a6-446e-91c8-a4b08cf59f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9069d91-8b50-446c-b983-645c9166eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:18 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 1073741824
Apr 09 10:44:18 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:18 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Volume volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a (f1c68631-2cf8-4297-a1d3-4c7b1be54f9a): created successfully
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9069d91-8b50-446c-b983-645c9166eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Flow 'volume_create_manager' (2adce7df-b4ef-4dc6-87a3-c0526e955abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:18 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7b4248c5-91ea-4766-9fab-0cb881d080a3 tempest-VolumesListTestJSON-1969183890 None] Created volume successfully.
Apr 09 10:44:18 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689" returned: 0 in 0.536s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f9ce9-e16f-40f0-9b59-a98a8d042347]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:18 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b
Apr 09 10:44:18 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Flow 'volume_create_manager' (d89d459d-85f9-4802-8e66-1ae44f9b0755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbc5106-25c3-489e-821e-26397037bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbc5106-25c3-489e-821e-26397037bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-346998997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e571d5-7017-4a87-a87a-14b22be59d43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9ade1a46c7942cfb79858adf2972f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:19Z,use_quota=True,user_id='e3d48b1fc7524105b4e27b483b352cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acc20b8-575b-457a-a81e-44232cea9d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acc20b8-575b-457a-a81e-44232cea9d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219659fe-c147-4dde-b11f-211aa8b22ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219659fe-c147-4dde-b11f-211aa8b22ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e571d5-7017-4a87-a87a-14b22be59d43', 'volume_name': 'volume-d5e571d5-7017-4a87-a87a-14b22be59d43', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e313d554-54f3-4df9-b609-55ce63c779c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e313d554-54f3-4df9-b609-55ce63c779c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a3f93e-8dd0-4126-9b14-add9252a3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:18 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Volume d5e571d5-7017-4a87-a87a-14b22be59d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e571d5-7017-4a87-a87a-14b22be59d43', 'volume_size': 1}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:18 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 1073741824" returned: 0 in 0.618s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:18 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335
Apr 09 10:44:18 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:19 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b" returned: 0 in 0.602s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:19 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689
Apr 09 10:44:19 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:19 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335" returned: 0 in 0.453s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-346998997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e571d5-7017-4a87-a87a-14b22be59d43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9ade1a46c7942cfb79858adf2972f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:19Z,use_quota=True,user_id='e3d48b1fc7524105b4e27b483b352cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Creating volume d5e571d5-7017-4a87-a87a-14b22be59d43 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:19 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172da7d-9c46-4bfd-8bf9-d08142b0ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:19 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43 1073741824
Apr 09 10:44:19 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7e2c0c-0ead-4347-8404-4e7e08b1dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:19 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Volume volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 (2fd26b34-6f3b-4f99-8b23-0eaf0849d335): created successfully
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7e2c0c-0ead-4347-8404-4e7e08b1dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Flow 'volume_create_manager' (b0e796f1-c707-45c5-82ff-299eddb7fc86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:19 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8a564b8a-7d9a-44b8-b884-b74872cbd1ad tempest-VolumeQuotasAdminTestJSON-1780164092 None] Created volume successfully.
Apr 09 10:44:19 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689" returned: 0 in 0.532s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:19 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689
Apr 09 10:44:19 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:19 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43 1073741824" returned: 0 in 0.629s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:20 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43
Apr 09 10:44:20 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:20 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b.6523de1a-24bb-4f2d-814d-bb2c51f68689" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-6523de1a-24bb-4f2d-814d-bb2c51f68689" released by "_delete_snapshot" :: held 2.228s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-3b7a4618-fa00-4636-bc06-0dc231b2e11b" released by "delete_snapshot" :: held 2.239s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4fb16fd0-566c-4261-ae94-5ed16dee4c01 tempest-VolumeQuotasAdminTestJSON-1688523154 None] Transfer volume completed successfully.
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Created reservations ['0c15d64d-f906-4fe8-85ea-8ed4127b22c9', '0076a043-a0de-41c0-999a-f582e37c4c2e', 'f33da693-529b-489e-8d5f-7943e89c0069', 'cea2ad3b-fc04-4ca1-93d1-850b2177a39c'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Delete snapshot completed successfully.
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b523e851-4e25-4b2a-b243-fb4202d158c5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-6523de1a-24bb-4f2d-814d-bb2c51f68689-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:20 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43" returned: 0 in 0.510s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a3f93e-8dd0-4126-9b14-add9252a3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e571d5-7017-4a87-a87a-14b22be59d43', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8439b010-57c2-4073-9ee8-be4c5a24cadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:20 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Volume volume-d5e571d5-7017-4a87-a87a-14b22be59d43 (d5e571d5-7017-4a87-a87a-14b22be59d43): created successfully
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8439b010-57c2-4073-9ee8-be4c5a24cadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:20 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Flow 'volume_create_manager' (d89d459d-85f9-4802-8e66-1ae44f9b0755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-732f6931-bdc1-48ea-b979-1a61ab31ed9e tempest-VolumesListTestJSON-1969183890 None] Created volume successfully.
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Acquiring lock "cinder-2fd26b34-6f3b-4f99-8b23-0eaf0849d335-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Lock "cinder-2fd26b34-6f3b-4f99-8b23-0eaf0849d335-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Acquiring lock "cinder-quobyte-2fd26b34-6f3b-4f99-8b23-0eaf0849d335" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Lock "cinder-quobyte-2fd26b34-6f3b-4f99-8b23-0eaf0849d335" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3ce60-4d4e-410b-bf50-5f3514193df9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-3b7a4618-fa00-4636-bc06-0dc231b2e11b-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-3b7a4618-fa00-4636-bc06-0dc231b2e11b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:21 devstack sudo[87801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335
Apr 09 10:44:21 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Flow 'volume_create_manager' (74dfc535-553d-4e3d-b2b6-3ddd3e869900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774185b3-7fbf-4813-97fc-e05402201c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-quobyte-3b7a4618-fa00-4636-bc06-0dc231b2e11b" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774185b3-7fbf-4813-97fc-e05402201c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1959666368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14239932-c961-4238-b645-c4854d502ae7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9ade1a46c7942cfb79858adf2972f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:21Z,use_quota=True,user_id='e3d48b1fc7524105b4e27b483b352cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccccdb12-24ba-47cb-a604-de7c8e74ce55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccccdb12-24ba-47cb-a604-de7c8e74ce55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9402c371-d206-4411-b1ef-3cae1e155b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9402c371-d206-4411-b1ef-3cae1e155b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14239932-c961-4238-b645-c4854d502ae7', 'volume_name': 'volume-14239932-c961-4238-b645-c4854d502ae7', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18529b20-7ff3-4809-81af-59492e97ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18529b20-7ff3-4809-81af-59492e97ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809adba8-959b-49eb-a1be-44357c942613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Volume 14239932-c961-4238-b645-c4854d502ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14239932-c961-4238-b645-c4854d502ae7', 'volume_size': 1}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1959666368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14239932-c961-4238-b645-c4854d502ae7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9ade1a46c7942cfb79858adf2972f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:21Z,use_quota=True,user_id='e3d48b1fc7524105b4e27b483b352cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Creating volume 14239932-c961-4238-b645-c4854d502ae7 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:21 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-3b7a4618-fa00-4636-bc06-0dc231b2e11b" acquired by "delete_volume" :: waited 0.062s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:21 devstack sudo[87803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7 1073741824
Apr 09 10:44:21 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfd0758-c6f7-43c2-949d-96494ab526d5]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:21 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b
Apr 09 10:44:21 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:21 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:21 devstack sudo[87810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335
Apr 09 10:44:21 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:21 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b" returned: 0 in 0.560s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:21 devstack sudo[87818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b
Apr 09 10:44:21 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:21 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7 1073741824" returned: 0 in 0.652s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:22 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7
Apr 09 10:44:22 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:22 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2fd26b34-6f3b-4f99-8b23-0eaf0849d335" returned: 0 in 0.606s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Lock "cinder-quobyte-2fd26b34-6f3b-4f99-8b23-0eaf0849d335" released by "delete_volume" :: held 1.228s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Created reservations ['f619df17-2ae7-4ccc-89f0-2b657fa2e58c', '62495f97-a279-4808-b404-3cb3c3f2db8b', 'c9560030-e947-49e4-945b-2007a671dafd', 'fb13e883-5239-4cad-8d8e-ced727cc5d36'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:22 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:22 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:22 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3b7a4618-fa00-4636-bc06-0dc231b2e11b" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-3b7a4618-fa00-4636-bc06-0dc231b2e11b" released by "delete_volume" :: held 1.120s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Created reservations ['d5b4b899-d7bd-45ee-b5d3-14359ae47810', 'b8cddf4b-7515-4174-bb10-00ae1f1c7fac', '58350c3e-534a-48f7-bcc9-862a791e637a', 'aacb8d51-a5b3-4657-8ae5-9e0a4ddff3bb'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:22 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7" returned: 0 in 0.511s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809adba8-959b-49eb-a1be-44357c942613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14239932-c961-4238-b645-c4854d502ae7', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7d26a7-6758-4030-8855-c233169c37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:22 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Volume volume-14239932-c961-4238-b645-c4854d502ae7 (14239932-c961-4238-b645-c4854d502ae7): created successfully
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7d26a7-6758-4030-8855-c233169c37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Flow 'volume_create_manager' (74dfc535-553d-4e3d-b2b6-3ddd3e869900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-529f9f2d-d493-436b-88e2-72bc4e2bec07 tempest-VolumesListTestJSON-1969183890 None] Created volume successfully.
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:22 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:22 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:22 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.505s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Deleted volume successfully.
Apr 09 10:44:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5eee83d6-d06d-4a82-8bc7-700c76b03769 tempest-VolumeQuotasAdminTestJSON-1789089433 None] Lock "cinder-2fd26b34-6f3b-4f99-8b23-0eaf0849d335-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:23 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:23 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Deleted volume successfully.
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a08dcc0a-ce88-43dc-a4bc-68f5d2769fe5 tempest-CinderUnicodeTest-991824396 None] Lock "cinder-3b7a4618-fa00-4636-bc06-0dc231b2e11b-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-2d35b52a-8f9a-43a0-9911-e551d742bee4-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Lock "cinder-2d35b52a-8f9a-43a0-9911-e551d742bee4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Acquiring lock "cinder-quobyte-2d35b52a-8f9a-43a0-9911-e551d742bee4" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-2d35b52a-8f9a-43a0-9911-e551d742bee4" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d1742-b137-41be-9569-18b903d2c1b7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:23 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4
Apr 09 10:44:23 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:24 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4" returned: 0 in 0.622s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:24 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4
Apr 09 10:44:24 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:24 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-2d35b52a-8f9a-43a0-9911-e551d742bee4" returned: 0 in 0.589s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Lock "cinder-quobyte-2d35b52a-8f9a-43a0-9911-e551d742bee4" released by "delete_volume" :: held 1.258s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Created reservations ['967d6cc3-fae3-4ab9-aea9-a1d5906f199f', 'bd780c0c-ea09-4c37-9272-bc7817018625', '983b05b4-5cb1-4ca1-b9b3-975d34fe3855', '2829999d-be94-41fd-8964-86429bb05646'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:24 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:24 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Flow 'volume_create_manager' (6410bb54-ad0b-4dd4-bd64-c9ad89d689ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963619fe-fd88-4356-b42f-9361ea5bd8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963619fe-fd88-4356-b42f-9361ea5bd8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-391211335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955fdaff-0fdf-4c40-95d4-e332bee7b5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c35c9c298c24837913f0ed2c1018165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:25Z,use_quota=True,user_id='704e82b60cb94551b036247ebcdab143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22fcc19-1beb-4e45-9d5c-100909f8f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22fcc19-1beb-4e45-9d5c-100909f8f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f950f-9779-4ceb-99a4-87f4f1b0290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.image.glance [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Creating Keystone auth plugin from conf {{(pid=82783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "cinder-14239932-c961-4238-b645-c4854d502ae7-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f950f-9779-4ceb-99a4-87f4f1b0290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '955fdaff-0fdf-4c40-95d4-e332bee7b5f4', 'volume_name': 'volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6957dc4d90>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1036026b-7d1a-40bf-905b-a3e92000da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1036026b-7d1a-40bf-905b-a3e92000da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960ff557-ace9-42bd-a69a-bf4bf5c0e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:25 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Volume 955fdaff-0fdf-4c40-95d4-e332bee7b5f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6957dc4d90>}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Trying to clone 955fdaff-0fdf-4c40-95d4-e332bee7b5f4 from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]). {{(pid=82783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-14239932-c961-4238-b645-c4854d502ae7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "cinder-quobyte-14239932-c961-4238-b645-c4854d502ae7" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-quobyte-14239932-c961-4238-b645-c4854d502ae7" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a9491-33b7-4b63-b6c4-3267f5cca57a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:25 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.665s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Deleted volume successfully.
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f3958a12-0633-4cae-95ae-992e0c25b76e tempest-CinderUnicodeTest-991824396 None] Lock "cinder-2d35b52a-8f9a-43a0-9911-e551d742bee4-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:25 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7
Apr 09 10:44:25 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 10:44:25 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e250bc67-756b-4901-bf78-09aee4763d0a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:25 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD
Apr 09 10:44:25 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:26 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7" returned: 0 in 0.616s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:26 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7
Apr 09 10:44:26 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:26 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 is fetched for user 704e82b60cb94551b036247ebcdab143. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a134439-7595-48f6-8625-153fee27f589]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:26 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD
Apr 09 10:44:26 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:26 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14239932-c961-4238-b645-c4854d502ae7" returned: 0 in 0.572s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-quobyte-14239932-c961-4238-b645-c4854d502ae7" released by "delete_volume" :: held 1.224s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Created reservations ['b1e9c217-db2c-4706-84c6-6f461fc744b7', '7319f524-3efc-4cca-8bc2-2556b72bdb92', '24c14b69-413e-4461-9e81-eeb9ef69c784', '9e5ef1c6-7df3-4b6b-9daa-34f5ad05fe91'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:26 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:26 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:27 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD" returned: 0 in 0.685s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-391211335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955fdaff-0fdf-4c40-95d4-e332bee7b5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c35c9c298c24837913f0ed2c1018165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:25Z,use_quota=True,user_id='704e82b60cb94551b036247ebcdab143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Creating volume 955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:27 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:27 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 1073741824
Apr 09 10:44:27 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:27 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Deleted volume successfully.
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6a70231c-9e5e-4d76-8c79-9c23386313ab tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-14239932-c961-4238-b645-c4854d502ae7-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:27 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 1073741824" returned: 0 in 0.559s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "cinder-d5e571d5-7017-4a87-a87a-14b22be59d43-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:27 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:27 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-d5e571d5-7017-4a87-a87a-14b22be59d43-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "cinder-quobyte-d5e571d5-7017-4a87-a87a-14b22be59d43" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-quobyte-d5e571d5-7017-4a87-a87a-14b22be59d43" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[021fc553-4bc9-4606-8ae9-1c1297599066]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:27 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43
Apr 09 10:44:27 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:28 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Attempting download of f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 955fdaff-0fdf-4c40-95d4-e332bee7b5f4. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a3cf0-9256-4cab-ac25-c036fbf6ff97]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:28 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:28 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43
Apr 09 10:44:28 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:28 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8
Apr 09 10:44:28 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Flow 'volume_create_manager' (0deb48ba-bf41-4e19-a008-ccf6329c9879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646ff1a0-ed2b-4a34-9d75-e97b897d8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646ff1a0-ed2b-4a34-9d75-e97b897d8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1005823568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2249b82-4353-4e04-ba3c-10b8038d7995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07627082665245b581748e44132b1ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:28Z,use_quota=True,user_id='170aee1720584c60bb9eea541342d96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437988ac-bede-4083-8c01-0af175aa7f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437988ac-bede-4083-8c01-0af175aa7f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29991e54-82ae-4f09-bdab-73184497141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29991e54-82ae-4f09-bdab-73184497141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2249b82-4353-4e04-ba3c-10b8038d7995', 'volume_name': 'volume-c2249b82-4353-4e04-ba3c-10b8038d7995', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6903c84-f627-46fc-8bd2-5086a4ca21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6903c84-f627-46fc-8bd2-5086a4ca21dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b15b42-0b6c-447c-b965-5c1f29f0f8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:28 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Volume c2249b82-4353-4e04-ba3c-10b8038d7995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2249b82-4353-4e04-ba3c-10b8038d7995', 'volume_size': 1}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1005823568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2249b82-4353-4e04-ba3c-10b8038d7995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07627082665245b581748e44132b1ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:28Z,use_quota=True,user_id='170aee1720584c60bb9eea541342d96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Creating volume c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:28 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:28 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 1073741824
Apr 09 10:44:28 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:28 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d5e571d5-7017-4a87-a87a-14b22be59d43" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-quobyte-d5e571d5-7017-4a87-a87a-14b22be59d43" released by "delete_volume" :: held 0.982s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:28 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:INSERT=56,cinder:UPDATE=243,cinder:SELECT=192,cinder:DELETE=22 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Created reservations ['5eaac796-4188-4616-b8b6-666001155edd', '2aca5358-a077-46e7-8fe1-d2c216be575a', '451cb0ed-8c73-404f-87a7-ba45d0f40126', '0209209c-6d43-4175-b661-1e2189ed5be7'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:28 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8
Apr 09 10:44:28 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:28 devstack sudo[87893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:28 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:28 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 1073741824" returned: 0 in 0.513s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:28 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995
Apr 09 10:44:28 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:29 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8" returned: 1 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_31ztusv8' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c47a693-7721-421f-94fd-12a2f76e49a2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:29 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.431s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:29 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Deleted volume successfully.
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e6309c15-34fb-498a-a817-52312e1f67d6 tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-d5e571d5-7017-4a87-a87a-14b22be59d43-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:29 devstack sudo[87901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD
Apr 09 10:44:29 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:29 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b15b42-0b6c-447c-b965-5c1f29f0f8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2249b82-4353-4e04-ba3c-10b8038d7995', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5ee488-6bbc-4342-b3a3-421b999f245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:29 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Volume volume-c2249b82-4353-4e04-ba3c-10b8038d7995 (c2249b82-4353-4e04-ba3c-10b8038d7995): created successfully
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5ee488-6bbc-4342-b3a3-421b999f245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Flow 'volume_create_manager' (0deb48ba-bf41-4e19-a008-ccf6329c9879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:29 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-cfa15774-d7df-4606-980a-3e7e4fdf1855 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Created volume successfully.
Apr 09 10:44:29 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] f4151152-a1b9-4cc0-94ca-126b9fa272f6 was qcow2, converting to raw {{(pid=82783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:29 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:29 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "cinder-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "cinder-quobyte-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-quobyte-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a" acquired by "delete_volume" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f788c-f385-41f3-bcc8-930665166f5b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:30 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a
Apr 09 10:44:30 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:30 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:30 devstack sudo[87930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a
Apr 09 10:44:30 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=196,cinder:INSERT=64,cinder:UPDATE=267,cinder:DELETE=16 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:30 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 0 in 0.894s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Creating offline snapshot 20b17fde-264b-428f-ad3a-2da8789099ab of volume c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_hhgld4zldevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:44:30 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Converted 112.00 MB image at 112.00 MB/s
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1120bb-37c9-467e-9547-3dfeb37d5598]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:30 devstack sudo[87932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 1G
Apr 09 10:44:30 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:30 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995
Apr 09 10:44:30 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:30 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a" returned: 0 in 0.428s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-quobyte-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a" released by "delete_volume" :: held 0.992s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Created reservations ['dff15852-9a20-4309-b7a8-bb6c136c617f', '51c61f2a-9dd5-4209-9d6d-3e37b66a320a', 'c8f568db-b721-4cbc-ab3b-4d18d4d954b9', 'b187406b-83d2-4950-bafb-8f68d0f5e054'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:31 devstack sudo[87940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:31 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:31 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 1G" returned: 0 in 0.437s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c9e97-4465-4b60-9fbe-439ead0cf2ab]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:31 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:31 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:31 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:31 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab 1G
Apr 09 10:44:31 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:31 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Deleted volume successfully.
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5108ebd5-cf58-4527-b79d-bd36ab84681e tempest-VolumesListTestJSON-1969183890 None] Lock "cinder-f1c68631-2cf8-4297-a1d3-4c7b1be54f9a-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:31 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab 1G" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2249b82-4353-4e04-ba3c-10b8038d7995 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:31 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 0 in 0.622s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:31 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2249b82-4353-4e04-ba3c-10b8038d7995 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab
Apr 09 10:44:31 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:31 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:31 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:32 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2249b82-4353-4e04-ba3c-10b8038d7995 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab" returned: 0 in 0.498s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:32 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab is being set with open permissions: ugo+rw
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:32 devstack sudo[87965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab
Apr 09 10:44:32 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:32 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 1 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Downloaded image f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 955fdaff-0fdf-4c40-95d4-e332bee7b5f4 successfully. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 for user 704e82b60cb94551b036247ebcdab143 is deleted. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Marking volume 955fdaff-0fdf-4c40-95d4-e332bee7b5f4 as bootable. {{(pid=82783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Copying metadata from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 to 955fdaff-0fdf-4c40-95d4-e332bee7b5f4. {{(pid=82783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Creating volume glance metadata for volume 955fdaff-0fdf-4c40-95d4-e332bee7b5f4 backed by image f4151152-a1b9-4cc0-94ca-126b9fa272f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960ff557-ace9-42bd-a69a-bf4bf5c0e80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6957dc4d90>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69dbf52-fdaa-4083-8461-58666f75cac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Volume volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 (955fdaff-0fdf-4c40-95d4-e332bee7b5f4): created successfully
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69dbf52-fdaa-4083-8461-58666f75cac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Flow 'volume_create_manager' (6410bb54-ad0b-4dd4-bd64-c9ad89d689ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6482ac2d-0258-4edc-976d-6913fc2e782b tempest-VolumesImageMetadata-367732400 None] Created volume successfully.
Apr 09 10:44:32 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab" returned: 0 in 0.486s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:32 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info
Apr 09 10:44:32 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Flow 'volume_create_manager' (8e2b88c4-2324-417b-b780-b6c7b082b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc353ab-bdfe-4ee5-8e95-7d776cb18361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc353ab-bdfe-4ee5-8e95-7d776cb18361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-876867954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd474dd-3ba1-4363-8ce9-7d96f9362507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2ec3af08ae490c9465c5b95f9f74f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:33Z,use_quota=True,user_id='ee455dbd38c04456a6bbd3e3e5d5edbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c16641-c2ca-436a-bad2-12f716e5169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c16641-c2ca-436a-bad2-12f716e5169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f50ce6-1e47-4497-86d4-c2bce39ea659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f50ce6-1e47-4497-86d4-c2bce39ea659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd474dd-3ba1-4363-8ce9-7d96f9362507', 'volume_name': 'volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b005a2-fe92-4108-a202-a101a270c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b005a2-fe92-4108-a202-a101a270c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b458174f-27a3-4c75-ac68-ab46495c3675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Volume bdd474dd-3ba1-4363-8ce9-7d96f9362507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507', 'volume_size': 1}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Acquiring lock "cinder-955fdaff-0fdf-4c40-95d4-e332bee7b5f4-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Lock "cinder-955fdaff-0fdf-4c40-95d4-e332bee7b5f4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Acquiring lock "cinder-quobyte-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Lock "cinder-quobyte-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5ac5a-2696-4188-9fe5-a21521c34a78]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:33 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:33 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:33 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info" returned: 0 in 0.444s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:33 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info is being set with open permissions: ugo+rw
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:33 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info
Apr 09 10:44:33 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:33 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 0 in 0.457s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:33 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:33 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:33 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.info" returned: 0 in 0.411s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-876867954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd474dd-3ba1-4363-8ce9-7d96f9362507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2ec3af08ae490c9465c5b95f9f74f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:33Z,use_quota=True,user_id='ee455dbd38c04456a6bbd3e3e5d5edbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Creating volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:33 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:33 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 1073741824
Apr 09 10:44:33 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c07c3bd2-9f17-43e8-b914-95ee80c6435d tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Create snapshot completed successfully
Apr 09 10:44:33 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 1 in 0.491s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:33 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4
Apr 09 10:44:33 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "cinder-20b17fde-264b-428f-ad3a-2da8789099ab-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-20b17fde-264b-428f-ad3a-2da8789099ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "cinder-quobyte-c2249b82-4353-4e04-ba3c-10b8038d7995" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-quobyte-c2249b82-4353-4e04-ba3c-10b8038d7995" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "cinder-quobyte-20b17fde-264b-428f-ad3a-2da8789099ab" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-quobyte-20b17fde-264b-428f-ad3a-2da8789099ab" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Deleting offline snapshot 20b17fde-264b-428f-ad3a-2da8789099ab of volume c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] snapshot_file for this snap is: volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a5d217-98e3-45aa-932f-8b40cab6cd22]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:34 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab
Apr 09 10:44:34 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:34 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 1073741824" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:34 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507
Apr 09 10:44:34 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:34 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" returned: 0 in 0.459s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Lock "cinder-quobyte-955fdaff-0fdf-4c40-95d4-e332bee7b5f4" released by "delete_volume" :: held 1.458s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Created reservations ['1acea240-135b-42ef-bb84-96d8e0153d9e', '14b66ea3-1f27-4e27-9235-8da2d9f85557', '6f566730-4a97-4084-843c-b0b78d305a84', 'ab9090af-8f54-4b52-ae4f-15da885075b4'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:34 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:34 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:34 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:34 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab" returned: 0 in 0.519s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2249b82-4353-4e04-ba3c-10b8038d7995(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1564f3cd-f4cb-40e3-9d52-fea20d9ba10b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b458174f-27a3-4c75-ac68-ab46495c3675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156e9284-1c57-4f2b-9e8f-18d65455bd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Volume volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 (bdd474dd-3ba1-4363-8ce9-7d96f9362507): created successfully
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156e9284-1c57-4f2b-9e8f-18d65455bd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Flow 'volume_create_manager' (8e2b88c4-2324-417b-b780-b6c7b082b812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8c7aee20-db4f-4204-83bb-fb671d3301ae tempest-VolumesSnapshotListTestJSON-34629372 None] Created volume successfully.
Apr 09 10:44:34 devstack sudo[88002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995
Apr 09 10:44:34 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:34 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.467s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Deleted volume successfully.
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48620381-c6d9-4860-8319-7848adb3e621 tempest-VolumesImageMetadata-367732400 None] Lock "cinder-955fdaff-0fdf-4c40-95d4-e332bee7b5f4-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Creating offline snapshot 4d16bac3-52bc-46f9-ac45-5218fd04d0ae of volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e434c-5a17-4bba-a230-15c28f7a4d3e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:35 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995" returned: 0 in 0.499s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:35 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507
Apr 09 10:44:35 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:35 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab
Apr 09 10:44:35 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:35 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507" returned: 0 in 0.566s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:35 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab" returned: 0 in 0.498s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:35 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae 1G
Apr 09 10:44:35 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:35 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab
Apr 09 10:44:35 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:36 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995.20b17fde-264b-428f-ad3a-2da8789099ab" returned: 0 in 0.448s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-quobyte-20b17fde-264b-428f-ad3a-2da8789099ab" released by "_delete_snapshot" :: held 2.039s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-quobyte-c2249b82-4353-4e04-ba3c-10b8038d7995" released by "delete_snapshot" :: held 2.051s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Created reservations ['fea6cc6d-51ce-4a15-96c2-dae22f944e49', '02b4e9b7-042a-4dcc-9320-66340766926c', '8bc9c5b8-82c4-4743-a3fc-84511e836ad3', '7e7c7f18-7d6a-4304-bc49-bd45e516b085'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Delete snapshot completed successfully.
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d7722ba-b6d4-4f6b-8e30-f4e57f600ded tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-20b17fde-264b-428f-ad3a-2da8789099ab-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:36 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae 1G" returned: 0 in 0.601s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:36 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:36 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:36 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.448s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:36 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae is being set with open permissions: ugo+rw
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:36 devstack sudo[88031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:36 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Flow 'volume_create_manager' (88315392-e9a3-4f6c-97de-704945dc7cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742b4efa-e8ea-4be9-ba7a-040b43ef63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742b4efa-e8ea-4be9-ba7a-040b43ef63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1075787968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cea1500-7b37-4491-b854-7ed31b570116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7392f2978814256a02a77f751821502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:37Z,use_quota=True,user_id='233f4fe1c0774901884c38325f2c64c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb33aab-5fbf-4746-a254-ec119652b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb33aab-5fbf-4746-a254-ec119652b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c6eda-6236-4d5a-b503-00960c1d0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c6eda-6236-4d5a-b503-00960c1d0126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cea1500-7b37-4491-b854-7ed31b570116', 'volume_name': 'volume-4cea1500-7b37-4491-b854-7ed31b570116', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894e0236-d33a-41e2-a8ec-0ce73ff3500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894e0236-d33a-41e2-a8ec-0ce73ff3500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cee156c-92bd-459c-bbc7-6b97388b404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:36 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Volume 4cea1500-7b37-4491-b854-7ed31b570116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cea1500-7b37-4491-b854-7ed31b570116', 'volume_size': 1}
Apr 09 10:44:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:37 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:37 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info
Apr 09 10:44:37 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "cinder-c2249b82-4353-4e04-ba3c-10b8038d7995-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-c2249b82-4353-4e04-ba3c-10b8038d7995-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "cinder-quobyte-c2249b82-4353-4e04-ba3c-10b8038d7995" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-quobyte-c2249b82-4353-4e04-ba3c-10b8038d7995" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d5cf2-9195-4339-85c0-7cbd9411fbb6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:37 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995
Apr 09 10:44:37 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:37 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info" returned: 0 in 0.415s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:37 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info is being set with open permissions: ugo+rw
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:37 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info
Apr 09 10:44:37 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:37 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:37 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995
Apr 09 10:44:37 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:37 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.info" returned: 0 in 0.410s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1075787968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cea1500-7b37-4491-b854-7ed31b570116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7392f2978814256a02a77f751821502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:37Z,use_quota=True,user_id='233f4fe1c0774901884c38325f2c64c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Creating volume 4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:37 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1b441b4a-b7f2-4d4e-a2aa-079e54ef1d3b tempest-VolumesSnapshotListTestJSON-34629372 None] Create snapshot completed successfully
Apr 09 10:44:37 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 1073741824
Apr 09 10:44:37 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:38 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c2249b82-4353-4e04-ba3c-10b8038d7995" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-quobyte-c2249b82-4353-4e04-ba3c-10b8038d7995" released by "delete_volume" :: held 0.953s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Created reservations ['086fde6d-cda5-4296-88a5-fdf837a1cd03', 'afdbf94a-4eee-4f69-bce8-e680dd9e8600', '29335ebe-58c4-4544-934e-856e08b7a5ff', '787acb9a-f2c1-4ccd-8b9e-8e3f83b39f81'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:38 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:38 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:38 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 1073741824" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:38 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116
Apr 09 10:44:38 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:38 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Deleted volume successfully.
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e3a19450-bfe8-4dfe-aad0-1aacd7343252 tempest-VolumeSnapshotQuotasNegativeTestJSON-1829328229 None] Lock "cinder-c2249b82-4353-4e04-ba3c-10b8038d7995-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:38 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116" returned: 0 in 0.474s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.747s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cee156c-92bd-459c-bbc7-6b97388b404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cea1500-7b37-4491-b854-7ed31b570116', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793206ed-b76f-42b3-9e22-9fca48aeaae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Volume volume-4cea1500-7b37-4491-b854-7ed31b570116 (4cea1500-7b37-4491-b854-7ed31b570116): created successfully
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793206ed-b76f-42b3-9e22-9fca48aeaae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Flow 'volume_create_manager' (88315392-e9a3-4f6c-97de-704945dc7cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Creating offline snapshot 8b14a844-ea65-4e18-ad44-c604a1e8c8cc of volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-81772784-e117-4136-837d-199ad4e3860f tempest-SnapshotMetadataTestJSON-740462428 None] Created volume successfully.
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd974b-26bb-4303-bd75-ef6b7ff955bd]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:39 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:39 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:39 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:39 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:39 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.525s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:39 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc 1G
Apr 09 10:44:39 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:39 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:39 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:40 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc 1G" returned: 0 in 0.606s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:40 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:40 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:40 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.467s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:40 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc is being set with open permissions: ugo+rw
Apr 09 10:44:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:40 devstack sudo[88077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:40 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:41 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.488s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.118s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Creating offline snapshot bf7e3270-a558-46b0-b249-5ced38efe2e2 of volume 4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-90f32c13-e3fe-451b-a92c-25780a6ef8d4 tempest-VolumesSnapshotListTestJSON-34629372 None] Create snapshot completed successfully
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd34dab-c169-4bdf-a468-c07d0c8b7bf2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:41 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116
Apr 09 10:44:41 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:41 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:41 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 1G
Apr 09 10:44:41 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Flow 'volume_create_manager' (0134c1ad-e369-4455-ba12-1da8de8a76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51aa2e4b-08e9-4dbb-b6ab-626bcb409e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51aa2e4b-08e9-4dbb-b6ab-626bcb409e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-798805595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cd879b-5aa1-462d-91cb-1fa430fda5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e418641982a4aa88bc1097222aaf511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:42Z,use_quota=True,user_id='124670bb647e4a03beaaaba2d961819f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87b27b54-d7e0-4e3e-9996-af508edd3b9c),volume_type_id=87b27b54-d7e0-4e3e-9996-af508edd3b9c)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61540cf6-201f-4d4b-abbd-7604ba012e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61540cf6-201f-4d4b-abbd-7604ba012e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da25eb6-9130-4608-8e65-ee7a533a0244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da25eb6-9130-4608-8e65-ee7a533a0244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56cd879b-5aa1-462d-91cb-1fa430fda5ba', 'volume_name': 'volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aa76ba-2c06-48bc-9e6e-0b5b4ad95718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aa76ba-2c06-48bc-9e6e-0b5b4ad95718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f9fd84-a97f-4acc-b147-32d8da4b1ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:41 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Volume 56cd879b-5aa1-462d-91cb-1fa430fda5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba', 'volume_size': 1}
Apr 09 10:44:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:42 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 1G" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cea1500-7b37-4491-b854-7ed31b570116 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:42 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cea1500-7b37-4491-b854-7ed31b570116 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2
Apr 09 10:44:42 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:42 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cea1500-7b37-4491-b854-7ed31b570116 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2" returned: 0 in 0.419s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:42 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 is being set with open permissions: ugo+rw
Apr 09 10:44:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:42 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2
Apr 09 10:44:42 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:42 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2" returned: 0 in 0.408s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:43 devstack sudo[88099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info
Apr 09 10:44:43 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:43 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info" returned: 0 in 0.410s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:43 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info is being set with open permissions: ugo+rw
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:43 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info
Apr 09 10:44:43 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:43 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.info" returned: 0 in 0.406s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.704s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.404s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Creating offline snapshot 8140b666-a712-4cc6-9620-dfe7f6a80b04 of volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:43 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-acce2615-1acf-4dad-801b-580e105d7ab2 tempest-SnapshotMetadataTestJSON-740462428 None] Create snapshot completed successfully
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a1039-133e-4079-8a4c-a5603b259e45]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:43 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:43 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:44 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.506s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:44 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 1G
Apr 09 10:44:44 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "cinder-bf7e3270-a558-46b0-b249-5ced38efe2e2-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-bf7e3270-a558-46b0-b249-5ced38efe2e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "cinder-quobyte-4cea1500-7b37-4491-b854-7ed31b570116" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-quobyte-4cea1500-7b37-4491-b854-7ed31b570116" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "cinder-quobyte-bf7e3270-a558-46b0-b249-5ced38efe2e2" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-quobyte-bf7e3270-a558-46b0-b249-5ced38efe2e2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Deleting offline snapshot bf7e3270-a558-46b0-b249-5ced38efe2e2 of volume 4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] snapshot_file for this snap is: volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ea0de8-0732-4598-9ade-36b8961ce5b0]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:44 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2
Apr 09 10:44:44 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:44 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 1G" returned: 0 in 0.521s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:44 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04
Apr 09 10:44:44 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:45 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2" returned: 0 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cea1500-7b37-4491-b854-7ed31b570116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e3240-bf72-4965-80b3-8283aad32f5e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:45 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116
Apr 09 10:44:45 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:45 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04" returned: 0 in 0.434s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:45 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 is being set with open permissions: ugo+rw
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:45 devstack sudo[88133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04
Apr 09 10:44:45 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:45 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:45 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2
Apr 09 10:44:45 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:45 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04" returned: 0 in 0.421s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.922s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-798805595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cd879b-5aa1-462d-91cb-1fa430fda5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e418641982a4aa88bc1097222aaf511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:42Z,use_quota=True,user_id='124670bb647e4a03beaaaba2d961819f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87b27b54-d7e0-4e3e-9996-af508edd3b9c),volume_type_id=87b27b54-d7e0-4e3e-9996-af508edd3b9c)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Creating volume 56cd879b-5aa1-462d-91cb-1fa430fda5ba {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:45 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:45 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba 1073741824
Apr 09 10:44:45 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ebe174a9-4d07-4982-b878-7fe051589807 tempest-VolumesSnapshotListTestJSON-34629372 None] Create snapshot completed successfully
Apr 09 10:44:46 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2" returned: 0 in 0.456s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:46 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2
Apr 09 10:44:46 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:46 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba 1073741824" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:46 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba
Apr 09 10:44:46 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:46 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116.bf7e3270-a558-46b0-b249-5ced38efe2e2" returned: 0 in 0.459s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-quobyte-bf7e3270-a558-46b0-b249-5ced38efe2e2" released by "_delete_snapshot" :: held 1.950s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-quobyte-4cea1500-7b37-4491-b854-7ed31b570116" released by "delete_snapshot" :: held 1.961s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Created reservations ['7d248c42-1036-440a-a7e1-0884a62ba25c', 'a1decff4-c653-49c9-ae26-6e1698f56e6f', 'd0484ca7-c1de-45a0-8003-1b40f3f60bad', 'cba0e70c-78d5-44b7-9d56-bc3120b10a87'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Delete snapshot completed successfully.
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ca6cd788-31fc-41e0-9077-3fbd8d6b13b5 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-bf7e3270-a558-46b0-b249-5ced38efe2e2-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:46 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "cinder-4cea1500-7b37-4491-b854-7ed31b570116-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f9fd84-a97f-4acc-b147-32d8da4b1ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b53bf6-4f86-41c4-a7d1-196fd62741ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-4cea1500-7b37-4491-b854-7ed31b570116-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:46 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Volume volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba (56cd879b-5aa1-462d-91cb-1fa430fda5ba): created successfully
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b53bf6-4f86-41c4-a7d1-196fd62741ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Flow 'volume_create_manager' (0134c1ad-e369-4455-ba12-1da8de8a76a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c4a17714-0dc9-4a4b-92a0-6988125eb678 tempest-VolumeTypesAccessTest-264048546 None] Created volume successfully.
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "cinder-quobyte-4cea1500-7b37-4491-b854-7ed31b570116" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-quobyte-4cea1500-7b37-4491-b854-7ed31b570116" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3496e2-acdb-48f3-9e47-9436f511b02e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:47 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116
Apr 09 10:44:47 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Acquiring lock "cinder-56cd879b-5aa1-462d-91cb-1fa430fda5ba-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Lock "cinder-56cd879b-5aa1-462d-91cb-1fa430fda5ba-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Acquiring lock "cinder-quobyte-56cd879b-5aa1-462d-91cb-1fa430fda5ba" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Lock "cinder-quobyte-56cd879b-5aa1-462d-91cb-1fa430fda5ba" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c18a76-c162-4787-862a-1216f753fe71]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:47 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba
Apr 09 10:44:47 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-8140b666-a712-4cc6-9620-dfe7f6a80b04-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-8140b666-a712-4cc6-9620-dfe7f6a80b04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-8140b666-a712-4cc6-9620-dfe7f6a80b04" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-8140b666-a712-4cc6-9620-dfe7f6a80b04" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Deleting offline snapshot 8140b666-a712-4cc6-9620-dfe7f6a80b04 of volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] snapshot_file for this snap is: volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[064c58b3-1a9d-4a91-88e9-66555a42a32c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:47 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04
Apr 09 10:44:47 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:47 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:47 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116
Apr 09 10:44:47 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:47 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba" returned: 0 in 0.581s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:47 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba
Apr 09 10:44:47 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:47 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04" returned: 0 in 0.494s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a80e0f1-17fb-432d-aebd-59277a4d7e67]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:47 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:47 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:47 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4cea1500-7b37-4491-b854-7ed31b570116" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-quobyte-4cea1500-7b37-4491-b854-7ed31b570116" released by "delete_volume" :: held 1.055s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:47 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Created reservations ['77ddff92-ae3c-4ac3-b27e-b86cf231bbf2', '9b7c368f-151a-4f4a-b6d3-96c1cc1593a0', 'b2ba3c4c-c8b0-4430-8c78-3360148c67a3', 'e493acc9-77c8-4158-8216-a67af8857a10'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:48 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:48 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:48 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-56cd879b-5aa1-462d-91cb-1fa430fda5ba" returned: 0 in 0.449s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Lock "cinder-quobyte-56cd879b-5aa1-462d-91cb-1fa430fda5ba" released by "delete_volume" :: held 1.064s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:48 devstack cinder-volume[82783]: WARNING cinder.quota [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2107615668 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2107615668, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:44:48 devstack cinder-volume[82783]: WARNING cinder.quota [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2107615668 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2107615668, it is now deprecated. Please use the default quota class for default quota.
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Created reservations ['57b5b8ed-5292-447e-9dc0-0029ea89bcd7', '91121bef-63f2-4e59-a929-72c50efd3a57', 'f25ce3af-6d15-44f9-8b4f-f5f27ef7b0ea', '26b42afb-e49a-471b-8ad6-01b2a42b4453'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:48 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:48 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:48 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.539s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:48 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04
Apr 09 10:44:48 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:48 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.418s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Deleted volume successfully.
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8d995072-5c81-41d9-bdf7-870631b90266 tempest-SnapshotMetadataTestJSON-740462428 None] Lock "cinder-4cea1500-7b37-4491-b854-7ed31b570116-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:48 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.446s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Deleted volume successfully.
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4289044b-1146-4803-8049-38ca8483dccf tempest-VolumeTypesAccessTest-264048546 None] Lock "cinder-56cd879b-5aa1-462d-91cb-1fa430fda5ba-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:48 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04" returned: 0 in 0.510s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:48 devstack sudo[88193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04
Apr 09 10:44:48 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:49 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8140b666-a712-4cc6-9620-dfe7f6a80b04" returned: 0 in 0.468s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-8140b666-a712-4cc6-9620-dfe7f6a80b04" released by "_delete_snapshot" :: held 2.069s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" released by "delete_snapshot" :: held 2.082s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:49 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Created reservations ['6d2cab5e-e43a-494e-ab36-c3a562063244', 'adb10e58-1cf0-4bda-ac8e-3a6763c045f4', 'aeb7916d-ab09-4aa5-b81d-e33ac9eed17f', '3c98d4ab-8291-4f74-aa44-104855ec08d5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Delete snapshot completed successfully.
Apr 09 10:44:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17469453-afd9-4a80-a654-fbb6eca55609 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-8140b666-a712-4cc6-9620-dfe7f6a80b04-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-8b14a844-ea65-4e18-ad44-c604a1e8c8cc-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-8b14a844-ea65-4e18-ad44-c604a1e8c8cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-8b14a844-ea65-4e18-ad44-c604a1e8c8cc" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-8b14a844-ea65-4e18-ad44-c604a1e8c8cc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Deleting offline snapshot 8b14a844-ea65-4e18-ad44-c604a1e8c8cc of volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] snapshot_file for this snap is: volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50764b4-6b79-4c47-b132-de9b39b9a2d9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:50 devstack sudo[88230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:50 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:51 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.604s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73aabdd-ad39-4fa4-a6ba-fa10aaeed3ca]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:51 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:51 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:51 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.646s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:51 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:51 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Flow 'volume_create_manager' (bcd92787-c296-4aba-9df0-1f6b0e5a0e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1edb83a-b7e9-4293-b618-f30f6b0d6d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1edb83a-b7e9-4293-b618-f30f6b0d6d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1983714038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3432ec-c7e5-4991-9637-930bba0d94d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e639f208024bbb8628f0cc5fa08336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:52Z,use_quota=True,user_id='78e0eacec99743fe8e1a799a23b1fe37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e31e9-c0d4-4176-a155-f3bd40205aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e31e9-c0d4-4176-a155-f3bd40205aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1fdfa2-5d70-43ef-b443-3116947162de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1fdfa2-5d70-43ef-b443-3116947162de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3432ec-c7e5-4991-9637-930bba0d94d1', 'volume_name': 'volume-8e3432ec-c7e5-4991-9637-930bba0d94d1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae753bb-1019-479e-97f8-e88b845f36f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae753bb-1019-479e-97f8-e88b845f36f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c57de7-dc4f-4acc-a83c-a081b73cc12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:52 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Volume 8e3432ec-c7e5-4991-9637-930bba0d94d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3432ec-c7e5-4991-9637-930bba0d94d1', 'volume_size': 1}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1983714038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3432ec-c7e5-4991-9637-930bba0d94d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e639f208024bbb8628f0cc5fa08336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:52Z,use_quota=True,user_id='78e0eacec99743fe8e1a799a23b1fe37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Creating volume 8e3432ec-c7e5-4991-9637-930bba0d94d1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:52 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:52 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 1073741824
Apr 09 10:44:52 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:52 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.564s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:52 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc
Apr 09 10:44:52 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:52 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 1073741824" returned: 0 in 0.539s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:52 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1
Apr 09 10:44:52 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:52 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.8b14a844-ea65-4e18-ad44-c604a1e8c8cc" returned: 0 in 0.484s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-8b14a844-ea65-4e18-ad44-c604a1e8c8cc" released by "_delete_snapshot" :: held 2.348s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" released by "delete_snapshot" :: held 2.374s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Created reservations ['f87fce5a-3bb7-49ca-9770-5f9f59cabeeb', '4b1770ec-d0f7-4654-9fe6-1ed8145b343d', 'bc8cca42-1ce1-405a-8c71-6758316647f6', '6c793256-f209-4ced-aa10-559601dc2cd5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:52 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Delete snapshot completed successfully.
Apr 09 10:44:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a985fef0-3767-4c7c-98a8-0816f455eea8 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-8b14a844-ea65-4e18-ad44-c604a1e8c8cc-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:53 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1" returned: 0 in 0.506s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c57de7-dc4f-4acc-a83c-a081b73cc12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3432ec-c7e5-4991-9637-930bba0d94d1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22df5da-e07d-428a-8c83-180b12655924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:53 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Volume volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 (8e3432ec-c7e5-4991-9637-930bba0d94d1): created successfully
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22df5da-e07d-428a-8c83-180b12655924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Flow 'volume_create_manager' (bcd92787-c296-4aba-9df0-1f6b0e5a0e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:53 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fc18572e-1309-4a91-844b-ebec47ba7cb9 tempest-VolumesTransfersV355Test-1987855526 None] Created volume successfully.
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-4d16bac3-52bc-46f9-ac45-5218fd04d0ae-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-4d16bac3-52bc-46f9-ac45-5218fd04d0ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-4d16bac3-52bc-46f9-ac45-5218fd04d0ae" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-4d16bac3-52bc-46f9-ac45-5218fd04d0ae" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Deleting offline snapshot 4d16bac3-52bc-46f9-ac45-5218fd04d0ae of volume bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] snapshot_file for this snap is: volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58d1d61-6980-43dd-89e9-eac2b30ffc3f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:53 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:53 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:54 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:44:54 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac093f-333d-4099-8c57-56e678e469ab]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:54 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507
Apr 09 10:44:54 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5a78fdd7-6d7e-4d54-9bba-2c1b1814436f tempest-VolumesTransfersV355Test-1928361726 None] Transfer volume completed successfully.
Apr 09 10:44:54 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507" returned: 0 in 0.579s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:54 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:54 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:55 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.495s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:55 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae
Apr 09 10:44:55 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Acquiring lock "cinder-8e3432ec-c7e5-4991-9637-930bba0d94d1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-8e3432ec-c7e5-4991-9637-930bba0d94d1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Acquiring lock "cinder-quobyte-8e3432ec-c7e5-4991-9637-930bba0d94d1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-quobyte-8e3432ec-c7e5-4991-9637-930bba0d94d1" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf11fd-14cb-402c-a75d-c7f3d0dbdbde]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:55 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1
Apr 09 10:44:55 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:55 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507.4d16bac3-52bc-46f9-ac45-5218fd04d0ae" returned: 0 in 0.486s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-4d16bac3-52bc-46f9-ac45-5218fd04d0ae" released by "_delete_snapshot" :: held 2.221s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" released by "delete_snapshot" :: held 2.237s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Created reservations ['94cabbf7-7bd4-4881-b57f-8a48c9b5886a', '1a8fa79a-249c-48e7-88ac-b4e8764b700e', 'e4a32887-d270-4f82-a993-d9f76dc7a3c1', '13c97efd-b036-4840-ada8-1be8efccff3d'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Delete snapshot completed successfully.
Apr 09 10:44:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b064185c-219c-47de-9efc-15685bcbbd63 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-4d16bac3-52bc-46f9-ac45-5218fd04d0ae-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:56 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:56 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1
Apr 09 10:44:56 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Flow 'volume_create_manager' (7d0242ef-ca08-422e-929f-fdfb15cde5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce0abdb-857b-47c5-93fa-12ebdae1750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce0abdb-857b-47c5-93fa-12ebdae1750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275594040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e668f9-ffa9-4b69-b3ce-41d01527b120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04351b9a0a1a4195acce8e67bc716a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:56Z,use_quota=True,user_id='2edcfb39ee1f4712a762a47f6f3ccfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456813e0-1604-467e-89fc-5d4d3e2b9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456813e0-1604-467e-89fc-5d4d3e2b9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767edf64-9e47-4cdd-9dd2-075cf6a19d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767edf64-9e47-4cdd-9dd2-075cf6a19d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e668f9-ffa9-4b69-b3ce-41d01527b120', 'volume_name': 'volume-26e668f9-ffa9-4b69-b3ce-41d01527b120', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4c19fe-d75e-44ac-a122-bd70b7aaf80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4c19fe-d75e-44ac-a122-bd70b7aaf80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ee324f-23a0-428e-a488-8cdb484fd890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Volume 26e668f9-ffa9-4b69-b3ce-41d01527b120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e668f9-ffa9-4b69-b3ce-41d01527b120', 'volume_size': 1}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275594040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e668f9-ffa9-4b69-b3ce-41d01527b120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04351b9a0a1a4195acce8e67bc716a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:56Z,use_quota=True,user_id='2edcfb39ee1f4712a762a47f6f3ccfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Creating volume 26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:56 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:56 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 1073741824
Apr 09 10:44:56 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:56 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-8e3432ec-c7e5-4991-9637-930bba0d94d1" returned: 0 in 0.410s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-quobyte-8e3432ec-c7e5-4991-9637-930bba0d94d1" released by "delete_volume" :: held 0.970s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Created reservations ['8c68f740-96ea-42c0-9531-453579044e89', '2a752ab3-8f37-40d6-a1f8-201af020ed21', '95446de2-2dad-47bd-86b1-566e9803b127', '66e891d6-8c50-479e-ae82-052ebc4b3b46'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:56 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:56 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:56 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 1073741824" returned: 0 in 0.516s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:56 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120
Apr 09 10:44:56 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-bdd474dd-3ba1-4363-8ce9-7d96f9362507-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-bdd474dd-3ba1-4363-8ce9-7d96f9362507-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Flow 'volume_create_manager' (24da438e-c4c6-4f2d-a277-c0841345219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4491976-9e16-4ed8-9ebb-4f3262b32d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4491976-9e16-4ed8-9ebb-4f3262b32d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1590033273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65542a3-19f7-4f88-a3df-cea50ffa04da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e639f208024bbb8628f0cc5fa08336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:57Z,use_quota=True,user_id='78e0eacec99743fe8e1a799a23b1fe37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93e7d3c-62f7-47c2-b20d-8a38f6c916e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93e7d3c-62f7-47c2-b20d-8a38f6c916e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3006b032-250f-4bec-9f62-1c14eae78a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3006b032-250f-4bec-9f62-1c14eae78a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65542a3-19f7-4f88-a3df-cea50ffa04da', 'volume_name': 'volume-d65542a3-19f7-4f88-a3df-cea50ffa04da', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bd75ef-ad0a-4fd1-8ae5-2a6a4e4b5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bd75ef-ad0a-4fd1-8ae5-2a6a4e4b5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45687aa-8b62-4328-a554-fe98b93a19f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Volume d65542a3-19f7-4f88-a3df-cea50ffa04da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65542a3-19f7-4f88-a3df-cea50ffa04da', 'volume_size': 1}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" acquired by "delete_volume" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9ad4b8-a2de-48ed-a9e3-e8976da6d18d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:57 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507
Apr 09 10:44:57 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:57 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.523s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Deleted volume successfully.
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38af1ad8-4650-4b5a-a920-599fd7fb840c tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-8e3432ec-c7e5-4991-9637-930bba0d94d1-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:57 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120" returned: 0 in 0.484s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1590033273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65542a3-19f7-4f88-a3df-cea50ffa04da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e639f208024bbb8628f0cc5fa08336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:44:57Z,use_quota=True,user_id='78e0eacec99743fe8e1a799a23b1fe37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Creating volume d65542a3-19f7-4f88-a3df-cea50ffa04da {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:44:57 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ee324f-23a0-428e-a488-8cdb484fd890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e668f9-ffa9-4b69-b3ce-41d01527b120', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf6cd65-8151-44f9-b737-b1157d0a5bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:57 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da 1073741824
Apr 09 10:44:57 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:57 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Volume volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 (26e668f9-ffa9-4b69-b3ce-41d01527b120): created successfully
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf6cd65-8151-44f9-b737-b1157d0a5bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Flow 'volume_create_manager' (7d0242ef-ca08-422e-929f-fdfb15cde5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c9343631-15d3-4d26-a301-c4436d836a77 tempest-VolumesDeleteCascade-1426491476 None] Created volume successfully.
Apr 09 10:44:57 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:57 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507
Apr 09 10:44:57 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:57 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da 1073741824" returned: 0 in 0.495s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:57 devstack sudo[88308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da
Apr 09 10:44:57 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:57 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bdd474dd-3ba1-4363-8ce9-7d96f9362507" returned: 0 in 0.445s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-quobyte-bdd474dd-3ba1-4363-8ce9-7d96f9362507" released by "delete_volume" :: held 0.986s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Created reservations ['98f9a077-3cb2-42f5-ae15-c8f898e82884', 'd2fb3147-e1a7-44b6-bfe8-9ecfbb04437c', '3e8e3023-324a-42d8-ac2f-ec43c91bfad2', 'f3ebcf5e-35c3-44d8-8c7b-471464fba012'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:58 devstack sudo[88311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:44:58 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:58 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da" returned: 0 in 0.441s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45687aa-8b62-4328-a554-fe98b93a19f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65542a3-19f7-4f88-a3df-cea50ffa04da', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86343be-2892-4724-91d7-300816028d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:44:58 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Volume volume-d65542a3-19f7-4f88-a3df-cea50ffa04da (d65542a3-19f7-4f88-a3df-cea50ffa04da): created successfully
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86343be-2892-4724-91d7-300816028d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Flow 'volume_create_manager' (24da438e-c4c6-4f2d-a277-c0841345219f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:44:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c6a750dd-c31d-417c-a522-e9744425ec17 tempest-VolumesTransfersV355Test-1987855526 None] Created volume successfully.
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Creating offline snapshot cba7fc17-9ea5-4750-a106-6d0d4b0349f8 of volume 26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f6eff-c6b2-4d2f-82e0-4dff084de608]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:58 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120
Apr 09 10:44:58 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:58 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:44:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Deleted volume successfully.
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-17a5e0ff-d708-40c1-b50b-172200d83277 tempest-VolumesSnapshotListTestJSON-34629372 None] Lock "cinder-bdd474dd-3ba1-4363-8ce9-7d96f9362507-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:44:58 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:58 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 1G
Apr 09 10:44:58 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:59 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 1G" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:59 devstack sudo[88325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:44:59 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Acquiring lock "cinder-d65542a3-19f7-4f88-a3df-cea50ffa04da-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-d65542a3-19f7-4f88-a3df-cea50ffa04da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Acquiring lock "cinder-quobyte-d65542a3-19f7-4f88-a3df-cea50ffa04da" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-quobyte-d65542a3-19f7-4f88-a3df-cea50ffa04da" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0376be-207e-4888-a9bd-1ab1f97aed2e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:59 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da
Apr 09 10:44:59 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:44:59 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.507s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:44:59 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 is being set with open permissions: ugo+rw
Apr 09 10:44:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:44:59 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:44:59 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:00 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da" returned: 0 in 0.542s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:00 devstack sudo[88337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da
Apr 09 10:45:00 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:00 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:00 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info
Apr 09 10:45:00 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:00 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d65542a3-19f7-4f88-a3df-cea50ffa04da" returned: 0 in 0.494s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-quobyte-d65542a3-19f7-4f88-a3df-cea50ffa04da" released by "delete_volume" :: held 1.063s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Created reservations ['f8aa7632-5454-4452-972d-c68ccdd6c189', '8173e214-bcfc-437e-b262-15751489e32a', '42c78dd8-a581-46c8-8b44-381bf42b4587', '3c1de0e8-ce4d-43fd-8119-2ab61bec4d1b'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:00 devstack sudo[88343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:00 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Flow 'volume_create_manager' (9c2abd3c-048b-4988-bc36-08373c34e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7941a3fa-ed11-4324-b221-82c9a9a923bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7941a3fa-ed11-4324-b221-82c9a9a923bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-982622616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eca9385-7f47-4247-8994-3030461a196e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74ae23fc62c468381528b8812a09bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:01Z,use_quota=True,user_id='c6a01b6cb0d64c41b7bd46a14f534079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5670e9af-6d7c-4bec-a476-701b7c7667e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5670e9af-6d7c-4bec-a476-701b7c7667e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5684b2c9-6c5f-40bc-9b99-7fed0a4bf496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5684b2c9-6c5f-40bc-9b99-7fed0a4bf496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eca9385-7f47-4247-8994-3030461a196e', 'volume_name': 'volume-4eca9385-7f47-4247-8994-3030461a196e', 'volume_size': 2}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2100f01e-5497-4cb2-a2b9-353982bde98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2100f01e-5497-4cb2-a2b9-353982bde98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9493da7b-2479-4d84-bc0e-5dd4ac0f49e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:00 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Volume 4eca9385-7f47-4247-8994-3030461a196e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eca9385-7f47-4247-8994-3030461a196e', 'volume_size': 2}
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:00 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:00 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info is being set with open permissions: ugo+rw
Apr 09 10:45:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:00 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info
Apr 09 10:45:00 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:01 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.428s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:01 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Deleted volume successfully.
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ec2ac9d9-89af-407d-b6dd-23139fc87930 tempest-VolumesTransfersV355Test-441276126 None] Lock "cinder-d65542a3-19f7-4f88-a3df-cea50ffa04da-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:01 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.info" returned: 0 in 0.403s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-982622616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eca9385-7f47-4247-8994-3030461a196e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74ae23fc62c468381528b8812a09bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:01Z,use_quota=True,user_id='c6a01b6cb0d64c41b7bd46a14f534079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Creating volume 4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:01 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e 2147483648 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:01 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e 2147483648
Apr 09 10:45:01 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:01 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ea64f466-ff54-4cdd-9179-cf29065f3f14 tempest-VolumesDeleteCascade-1426491476 None] Create snapshot completed successfully
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:01 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e 2147483648" returned: 0 in 0.532s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:01 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e
Apr 09 10:45:01 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:02 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e" returned: 0 in 0.420s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.678s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9493da7b-2479-4d84-bc0e-5dd4ac0f49e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eca9385-7f47-4247-8994-3030461a196e', 'volume_size': 2}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d198889-b502-4225-a8e6-69ac36ce9e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Creating offline snapshot 26f9352c-62e0-4477-9210-4f5415ab8f51 of volume 26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:45:02 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Volume volume-4eca9385-7f47-4247-8994-3030461a196e (4eca9385-7f47-4247-8994-3030461a196e): created successfully
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d198889-b502-4225-a8e6-69ac36ce9e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Flow 'volume_create_manager' (9c2abd3c-048b-4988-bc36-08373c34e45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd519866-ceda-4b1e-aa69-d87d8982bc16]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4f37b260-40bd-453e-8713-4fb5091c654c tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Created volume successfully.
Apr 09 10:45:02 devstack sudo[88359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:45:02 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:02 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.534s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e668f9-ffa9-4b69-b3ce-41d01527b120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:02 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 1G
Apr 09 10:45:02 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:03 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 1G" returned: 0 in 0.567s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:03 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51
Apr 09 10:45:03 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:03 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:03 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 is being set with open permissions: ugo+rw
Apr 09 10:45:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:03 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51
Apr 09 10:45:03 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:04 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.409s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Creating offline snapshot 6e9552ad-9da7-412c-9e3c-3650dc748f85 of volume 4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:45:04 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4d486ff0-dcd8-4fd8-98f0-4a4127c98ea6 tempest-VolumesDeleteCascade-1426491476 None] Create snapshot completed successfully
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e438d7-66fe-42ff-9f03-118173ddbc00]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:04 devstack sudo[88378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e
Apr 09 10:45:04 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-26e668f9-ffa9-4b69-b3ce-41d01527b120-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-26e668f9-ffa9-4b69-b3ce-41d01527b120-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Performing cascade delete. {{(pid=82783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-26f9352c-62e0-4477-9210-4f5415ab8f51-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-26f9352c-62e0-4477-9210-4f5415ab8f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-26f9352c-62e0-4477-9210-4f5415ab8f51" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26f9352c-62e0-4477-9210-4f5415ab8f51" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Deleting offline snapshot 26f9352c-62e0-4477-9210-4f5415ab8f51 of volume 26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] snapshot_file for this snap is: volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb2c19a-0076-4d2c-9a17-e05b31fd371f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:04 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51
Apr 09 10:45:04 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:05 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e" returned: 0 in 0.542s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 2G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:05 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 2G
Apr 09 10:45:05 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:05 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51" returned: 0 in 0.546s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e668f9-ffa9-4b69-b3ce-41d01527b120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df1396f-fc63-404d-b98c-132ad5af1321]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:05 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:45:05 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:05 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 2G" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eca9385-7f47-4247-8994-3030461a196e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:05 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eca9385-7f47-4247-8994-3030461a196e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85
Apr 09 10:45:05 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:05 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.565s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e668f9-ffa9-4b69-b3ce-41d01527b120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:05 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51
Apr 09 10:45:05 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:06 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eca9385-7f47-4247-8994-3030461a196e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:06 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 is being set with open permissions: ugo+rw
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:06 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85
Apr 09 10:45:06 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:06 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51" returned: 0 in 0.496s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:06 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85" returned: 0 in 0.441s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:06 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51
Apr 09 10:45:06 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:06 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info
Apr 09 10:45:06 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:06 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.26f9352c-62e0-4477-9210-4f5415ab8f51" returned: 0 in 0.469s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26f9352c-62e0-4477-9210-4f5415ab8f51" released by "_delete_snapshot" :: held 2.134s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:06 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" released by "delete_snapshot" :: held 2.146s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:06 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info is being set with open permissions: ugo+rw
Apr 09 10:45:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:06 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info
Apr 09 10:45:06 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Created reservations ['5a647fa4-cdd5-4f2e-8f9b-e8e439eb7d60', '4a3df195-8d1a-485d-94ed-73af1004e980', 'c0e9db40-5e7b-483c-af12-9e89fd5fd704', '6845e4c5-c4b0-42c4-bcb4-5cbe7ab86e9c'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:07 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Delete snapshot completed successfully.
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-26f9352c-62e0-4477-9210-4f5415ab8f51-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-cba7fc17-9ea5-4750-a106-6d0d4b0349f8-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-cba7fc17-9ea5-4750-a106-6d0d4b0349f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-cba7fc17-9ea5-4750-a106-6d0d4b0349f8" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-cba7fc17-9ea5-4750-a106-6d0d4b0349f8" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Deleting offline snapshot cba7fc17-9ea5-4750-a106-6d0d4b0349f8 of volume 26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] snapshot_file for this snap is: volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e73ce-04c7-4e71-b652-6d7ebaa4414b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:07 devstack sudo[88419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:45:07 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:07 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.info" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:07 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-207d817b-daae-4a6d-b20e-322f8d8bd236 tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Create snapshot completed successfully
Apr 09 10:45:07 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e668f9-ffa9-4b69-b3ce-41d01527b120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6e3a4-c928-47a0-a759-5f4b44162a24]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:07 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120
Apr 09 10:45:07 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:08 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120" returned: 0 in 0.556s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "cinder-6e9552ad-9da7-412c-9e3c-3650dc748f85-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-6e9552ad-9da7-412c-9e3c-3650dc748f85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "cinder-quobyte-4eca9385-7f47-4247-8994-3030461a196e" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:08 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:45:08 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-quobyte-4eca9385-7f47-4247-8994-3030461a196e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "cinder-quobyte-6e9552ad-9da7-412c-9e3c-3650dc748f85" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-quobyte-6e9552ad-9da7-412c-9e3c-3650dc748f85" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Deleting offline snapshot 6e9552ad-9da7-412c-9e3c-3650dc748f85 of volume 4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] snapshot_file for this snap is: volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e33bb9-87c3-4593-a2b3-caee399d1298]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:08 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85
Apr 09 10:45:08 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:08 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.557s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:08 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8
Apr 09 10:45:08 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:09 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85" returned: 0 in 0.661s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eca9385-7f47-4247-8994-3030461a196e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d77a0f4-7bb3-45cf-b306-f14e90ae81b1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:09 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e
Apr 09 10:45:09 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:09 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120.cba7fc17-9ea5-4750-a106-6d0d4b0349f8" returned: 0 in 0.599s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-cba7fc17-9ea5-4750-a106-6d0d4b0349f8" released by "_delete_snapshot" :: held 2.364s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" released by "delete_snapshot" :: held 2.374s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Created reservations ['aaec3f40-3ba2-44cf-99e5-9e8aa5c5469d', '9cdd32be-6359-419c-99f0-3aa5aa620e21', '5ade9a7d-c3a6-4215-8d24-4bd90adc7dc4', 'bdc8888e-d582-4c5e-b96c-fea9691728db'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:09 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Delete snapshot completed successfully.
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-cba7fc17-9ea5-4750-a106-6d0d4b0349f8-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Snapshots deleted, issuing volume delete {{(pid=82783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861065d-5e62-4fb2-9744-3546e47d1966]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:09 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e" returned: 0 in 0.546s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:09 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85
Apr 09 10:45:09 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:09 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120
Apr 09 10:45:09 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:10 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120" returned: 0 in 0.570s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:10 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:10 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120
Apr 09 10:45:10 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85" returned: 0 in 0.556s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:10 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85
Apr 09 10:45:10 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Flow 'volume_create_manager' (67aaff25-7e56-448c-afd2-98084e7514b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8ce714-6889-44bd-b480-260a43158fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8ce714-6889-44bd-b480-260a43158fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949680242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85db5e68-1d79-4daf-bf05-758d883d3ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0a04ebdb54483db65244993b8ec749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:10Z,use_quota=True,user_id='c2c757a80f3d4d2c8450a279704dded6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d388d713-ab17-483b-947e-6009875bcdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d388d713-ab17-483b-947e-6009875bcdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271ba98b-9523-47f7-ad15-a49572bf7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271ba98b-9523-47f7-ad15-a49572bf7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85db5e68-1d79-4daf-bf05-758d883d3ec0', 'volume_name': 'volume-85db5e68-1d79-4daf-bf05-758d883d3ec0', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854e02bc-a46f-40fb-a68d-e794ffa4874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854e02bc-a46f-40fb-a68d-e794ffa4874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae3fb9-1599-4b8d-91c1-9bd7294cf7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:10 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Volume 85db5e68-1d79-4daf-bf05-758d883d3ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85db5e68-1d79-4daf-bf05-758d883d3ec0', 'volume_size': 1}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949680242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85db5e68-1d79-4daf-bf05-758d883d3ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0a04ebdb54483db65244993b8ec749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:10Z,use_quota=True,user_id='c2c757a80f3d4d2c8450a279704dded6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Creating volume 85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:10 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:10 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 1073741824
Apr 09 10:45:10 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:10 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e.6e9552ad-9da7-412c-9e3c-3650dc748f85" returned: 0 in 0.421s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:10 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-26e668f9-ffa9-4b69-b3ce-41d01527b120" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-26e668f9-ffa9-4b69-b3ce-41d01527b120" released by "delete_volume" :: held 1.063s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-quobyte-6e9552ad-9da7-412c-9e3c-3650dc748f85" released by "_delete_snapshot" :: held 2.268s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-quobyte-4eca9385-7f47-4247-8994-3030461a196e" released by "delete_snapshot" :: held 2.284s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Created reservations ['6310f1eb-1327-4ec2-ab86-8a8e5a56363f', '6aa26a03-94c6-4806-8921-8057156b4cc7', 'f821b62a-c5aa-44db-938a-2cd665645aaf', 'a6d11b87-d4b3-4189-b968-f08c254c7e13'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Created reservations ['a737a0e4-0497-41a8-a46c-b30ccc28b7e6', '45d5e829-afe3-4221-b4a7-1bdb64dbd80e', '2d7b88e0-1be1-42ae-b5a2-3d5d11f87843', 'dbbde87e-098e-46e2-8a69-62d19a951831'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:10 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:10 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:10 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Delete snapshot completed successfully.
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-468a6aef-c956-4e2d-b5be-1b3b3885a3be tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-6e9552ad-9da7-412c-9e3c-3650dc748f85-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:10 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 1073741824" returned: 0 in 0.515s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:11 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:45:11 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:11 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.424s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Deleted volume successfully.
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-419fe4f2-f504-41c7-b4ca-57b64d3c192f tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-26e668f9-ffa9-4b69-b3ce-41d01527b120-delete_volume" released by "delete_volume" :: held 6.418s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:11 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae3fb9-1599-4b8d-91c1-9bd7294cf7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85db5e68-1d79-4daf-bf05-758d883d3ec0', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66379a58-7f6c-4d54-a772-cd4c8493154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Volume volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 (85db5e68-1d79-4daf-bf05-758d883d3ec0): created successfully
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66379a58-7f6c-4d54-a772-cd4c8493154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Flow 'volume_create_manager' (67aaff25-7e56-448c-afd2-98084e7514b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Flow 'volume_create_manager' (6addccd0-803c-4d98-959d-c943edd8882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9165d7-5e21-4f00-a270-419b06d5b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6d7e9399-9d75-4971-a81e-cafb66a832a1 tempest-VolumesActionsTest-1148795082 None] Created volume successfully.
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9165d7-5e21-4f00-a270-419b06d5b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2028519587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90300258-63bc-46be-aa97-a587d5029459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04351b9a0a1a4195acce8e67bc716a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:11Z,use_quota=True,user_id='2edcfb39ee1f4712a762a47f6f3ccfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d821500-ad86-437f-b204-19c6f61ea4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d821500-ad86-437f-b204-19c6f61ea4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5906ccf5-7b5a-4902-86ac-48c6f2e12529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5906ccf5-7b5a-4902-86ac-48c6f2e12529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90300258-63bc-46be-aa97-a587d5029459', 'volume_name': 'volume-90300258-63bc-46be-aa97-a587d5029459', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99cdfad-75db-4f4f-91a3-a6afd641c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99cdfad-75db-4f4f-91a3-a6afd641c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae1f32e-b2c8-4cd4-b815-7653b731a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Volume 90300258-63bc-46be-aa97-a587d5029459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90300258-63bc-46be-aa97-a587d5029459', 'volume_size': 1}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2028519587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90300258-63bc-46be-aa97-a587d5029459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04351b9a0a1a4195acce8e67bc716a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:11Z,use_quota=True,user_id='2edcfb39ee1f4712a762a47f6f3ccfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Creating volume 90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:11 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:11 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 1073741824
Apr 09 10:45:11 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "cinder-4eca9385-7f47-4247-8994-3030461a196e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-4eca9385-7f47-4247-8994-3030461a196e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "cinder-quobyte-4eca9385-7f47-4247-8994-3030461a196e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-quobyte-4eca9385-7f47-4247-8994-3030461a196e" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5637a203-dc8d-4687-a83b-e102316147ec]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:11 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e
Apr 09 10:45:11 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:12 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 1073741824" returned: 0 in 0.495s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:12 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:12 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:12 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:12 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e
Apr 09 10:45:12 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:12 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.444s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae1f32e-b2c8-4cd4-b815-7653b731a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90300258-63bc-46be-aa97-a587d5029459', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed01bde-9be1-4795-9994-05d80af4f6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:12 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Volume volume-90300258-63bc-46be-aa97-a587d5029459 (90300258-63bc-46be-aa97-a587d5029459): created successfully
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed01bde-9be1-4795-9994-05d80af4f6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Flow 'volume_create_manager' (6addccd0-803c-4d98-959d-c943edd8882a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-365faa99-9d2d-4079-891a-4026e79e9634 tempest-VolumesDeleteCascade-1426491476 None] Created volume successfully.
Apr 09 10:45:12 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4eca9385-7f47-4247-8994-3030461a196e" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-quobyte-4eca9385-7f47-4247-8994-3030461a196e" released by "delete_volume" :: held 0.946s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Created reservations ['ac394878-0026-43f1-a40e-980d73089cd5', '7a65549f-4b07-4dea-8bb4-25ba57b99d86', 'ebaca1b3-dcc9-47d3-b541-bee900b6f7bb', '2fa5046d-ba91-4c4e-a9b8-394add568525'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:12 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:12 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:13 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Deleted volume successfully.
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4fadd353-245b-43fe-9915-cfdd8657d8fe tempest-VolumesSnapshotNegativeTestJSON-2008273956 None] Lock "cinder-4eca9385-7f47-4247-8994-3030461a196e-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Creating offline snapshot 1860b10a-baf4-41b2-89e4-a7786b67907b of volume 90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e558f1-1882-45f8-beac-e71bf6c2bd7f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:13 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:13 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:14 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.577s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:14 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b 1G
Apr 09 10:45:14 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (5ab608c6-4666-4aac-a847-565bb7dccafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f059157-fb6d-4c89-b742-99bb5f3cd20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f059157-fb6d-4c89-b742-99bb5f3cd20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1463548982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6a0454-a83b-4c93-a684-9dbb49eaca6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4dea591b6494b93ab37d08cecf464a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:15Z,use_quota=True,user_id='2416c53fb2624b839b61b66279f4b86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fa8045-ed2d-42a2-b3bc-2f70d88f679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fa8045-ed2d-42a2-b3bc-2f70d88f679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf9b145-5b9d-4fc1-9db2-6039fc7c47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf9b145-5b9d-4fc1-9db2-6039fc7c47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6a0454-a83b-4c93-a684-9dbb49eaca6e', 'volume_name': 'volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59213398-bed1-473c-bcaa-68a24eefff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59213398-bed1-473c-bcaa-68a24eefff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fec95c-a438-460a-84c8-b88b49350e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:14 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Volume ac6a0454-a83b-4c93-a684-9dbb49eaca6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e', 'volume_size': 1}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:14 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b 1G" returned: 0 in 0.539s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90300258-63bc-46be-aa97-a587d5029459 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:14 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90300258-63bc-46be-aa97-a587d5029459 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b
Apr 09 10:45:14 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:15 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90300258-63bc-46be-aa97-a587d5029459 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:15 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b is being set with open permissions: ugo+rw
Apr 09 10:45:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:15 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b
Apr 09 10:45:15 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:15 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b" returned: 0 in 0.435s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:15 devstack sudo[88517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info
Apr 09 10:45:15 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:16 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info" returned: 0 in 0.405s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:16 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info is being set with open permissions: ugo+rw
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:16 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info
Apr 09 10:45:16 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:16 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.info" returned: 0 in 0.453s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.991s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1463548982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6a0454-a83b-4c93-a684-9dbb49eaca6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4dea591b6494b93ab37d08cecf464a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:15Z,use_quota=True,user_id='2416c53fb2624b839b61b66279f4b86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Creating volume ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:16 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c5e4303f-8594-4ed9-92fe-d51d16d32d2f tempest-VolumesDeleteCascade-1426491476 None] Create snapshot completed successfully
Apr 09 10:45:16 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e 1073741824
Apr 09 10:45:16 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Flow 'volume_create_manager' (da3ebdfa-368f-44a9-a323-12ec0d5da1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6023c4-f0e5-4012-aeda-77c6bb2fa3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6023c4-f0e5-4012-aeda-77c6bb2fa3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1055182409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04351b9a0a1a4195acce8e67bc716a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1860b10a-baf4-41b2-89e4-a7786b67907b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:17Z,use_quota=True,user_id='2edcfb39ee1f4712a762a47f6f3ccfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8379f95c-5af7-4c5a-a0a3-2d145f3e38ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8379f95c-5af7-4c5a-a0a3-2d145f3e38ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9a7b69-25af-4be1-bda8-3e59b0fbb939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9a7b69-25af-4be1-bda8-3e59b0fbb939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60', 'volume_name': 'volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60', 'volume_size': 1, 'snapshot_id': '1860b10a-baf4-41b2-89e4-a7786b67907b'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcb02dd-fd35-4d6c-94cc-75b3a408592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcb02dd-fd35-4d6c-94cc-75b3a408592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7f36fc-505a-44e6-bbb7-7efb23fcdeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:17 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Volume 5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60', 'volume_size': 1, 'snapshot_id': '1860b10a-baf4-41b2-89e4-a7786b67907b'}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:17 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e 1073741824" returned: 0 in 0.553s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:17 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:17 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:17 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.468s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-1860b10a-baf4-41b2-89e4-a7786b67907b-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fec95c-a438-460a-84c8-b88b49350e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b98a82d-6190-4faf-8f60-d2e955229442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:17 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Volume volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e (ac6a0454-a83b-4c93-a684-9dbb49eaca6e): created successfully
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b98a82d-6190-4faf-8f60-d2e955229442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (5ab608c6-4666-4aac-a847-565bb7dccafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-1860b10a-baf4-41b2-89e4-a7786b67907b-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Creating volume 5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 from snapshot 1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-188b0efe-7d1d-46a7-9d23-eee7a8499c4e tempest-VolumeDependencyTests-384419835 None] Created volume successfully.
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] snapshot: 1860b10a-baf4-41b2-89e4-a7786b67907b, volume: 5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae05c15-6073-457a-b058-2319b210dd8c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:17 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b
Apr 09 10:45:17 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:18 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b" returned: 0 in 0.591s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90300258-63bc-46be-aa97-a587d5029459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c865fff-f428-4ae1-9523-36af8ea34924]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:18 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:18 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:18 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.557s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:45:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:18 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60
Apr 09 10:45:18 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:21 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" returned: 0 in 2.169s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:21 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8b21c5-0daa-4cd1-9d61-7c6105a81b99]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:21 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:21 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:21 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.644s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:21 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:45:21 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Converted 1024.00 MB image at 471.90 MB/s
Apr 09 10:45:21 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 is being set with open permissions: ugo+rw
Apr 09 10:45:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:21 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60
Apr 09 10:45:21 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:22 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" returned: 0 in 0.415s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" released by "_copy_volume_from_snapshot" :: held 4.448s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-1860b10a-baf4-41b2-89e4-a7786b67907b-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" released by "_create_volume_from_snapshot" :: held 4.470s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.507s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.233s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Creating offline snapshot 1e7080a3-fa33-4524-8fe2-a7f62bf215fd of volume ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7f36fc-505a-44e6-bbb7-7efb23fcdeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60', 'volume_size': 1, 'snapshot_id': '1860b10a-baf4-41b2-89e4-a7786b67907b'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ab3ca8-a24e-43f3-9560-f94a6ec04909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba47521e-7091-463d-b2af-0b0668435e46]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:22 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Volume volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 (5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60): created successfully
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ab3ca8-a24e-43f3-9560-f94a6ec04909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Flow 'volume_create_manager' (da3ebdfa-368f-44a9-a323-12ec0d5da1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-830c56cf-18cb-487d-87bf-a8bf6fef8e61 tempest-VolumesDeleteCascade-1426491476 None] Created volume successfully.
Apr 09 10:45:22 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:22 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-90300258-63bc-46be-aa97-a587d5029459-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-90300258-63bc-46be-aa97-a587d5029459-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Performing cascade delete. {{(pid=82783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-1860b10a-baf4-41b2-89e4-a7786b67907b-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-1860b10a-baf4-41b2-89e4-a7786b67907b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-90300258-63bc-46be-aa97-a587d5029459" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-90300258-63bc-46be-aa97-a587d5029459" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-1860b10a-baf4-41b2-89e4-a7786b67907b" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-1860b10a-baf4-41b2-89e4-a7786b67907b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Deleting offline snapshot 1860b10a-baf4-41b2-89e4-a7786b67907b of volume 90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] snapshot_file for this snap is: volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[366edd0a-8662-4f9d-b834-8e152ac5012f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:22 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b
Apr 09 10:45:22 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:22 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.528s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:22 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd 1G
Apr 09 10:45:22 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:23 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b" returned: 0 in 0.538s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90300258-63bc-46be-aa97-a587d5029459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87a3901-c71f-47c0-91f7-3b8117fc6a2b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:23 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:23 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:23 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd 1G" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:23 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd
Apr 09 10:45:23 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:23 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:23 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b
Apr 09 10:45:23 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:23 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd" returned: 0 in 0.461s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:23 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd is being set with open permissions: ugo+rw
Apr 09 10:45:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:23 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd
Apr 09 10:45:23 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:24 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b" returned: 0 in 0.569s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:24 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b
Apr 09 10:45:24 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:24 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:24 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info
Apr 09 10:45:24 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:24 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459.1860b10a-baf4-41b2-89e4-a7786b67907b" returned: 0 in 0.596s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-1860b10a-baf4-41b2-89e4-a7786b67907b" released by "_delete_snapshot" :: held 2.256s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-90300258-63bc-46be-aa97-a587d5029459" released by "delete_snapshot" :: held 2.266s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Created reservations ['3c387db4-ddbf-4cea-8415-23cb7081907a', '283b0735-da4b-45c4-9b63-e4bb2d80095c', '5995acc6-343a-499a-bea7-43a7fa4f1040', '604c9cdc-43c5-4f79-b6e4-c06e0bead6f1'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Delete snapshot completed successfully.
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-1860b10a-baf4-41b2-89e4-a7786b67907b-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Snapshots deleted, issuing volume delete {{(pid=82783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-90300258-63bc-46be-aa97-a587d5029459" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-90300258-63bc-46be-aa97-a587d5029459" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:24 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info" returned: 0 in 0.597s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:24 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info is being set with open permissions: ugo+rw
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7fb36a-89ef-4f34-9488-03807ca81a40]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:24 devstack sudo[88649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info
Apr 09 10:45:24 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:25 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:25 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:25 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.info" returned: 0 in 0.423s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-155781be-db3f-456a-9d22-cf0e3b658d3c tempest-VolumeDependencyTests-384419835 None] Create snapshot completed successfully
Apr 09 10:45:25 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.557s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:25 devstack sudo[88657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459
Apr 09 10:45:25 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:25 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90300258-63bc-46be-aa97-a587d5029459" returned: 0 in 0.443s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-90300258-63bc-46be-aa97-a587d5029459" released by "delete_volume" :: held 1.040s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:25 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Created reservations ['3d36885c-e5de-4ee5-822c-4faedc5d35e0', 'c194c7d4-f554-4f25-ac2c-507a13452eae', 'b548fd4d-e6d8-424f-85fb-4829264f29a6', '0674ca90-851b-48f7-b3c5-7619ed68294b'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:26 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:26 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:26 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.434s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Deleted volume successfully.
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6bb450be-0e4a-4d42-b74a-60b0792340d6 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-90300258-63bc-46be-aa97-a587d5029459-delete_volume" released by "delete_volume" :: held 4.010s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (aefa5d15-2dc7-46bb-a817-3c2d225cf067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7f7f26-b0f6-4817-8240-91953a2f389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7f7f26-b0f6-4817-8240-91953a2f389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1446517145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99170a0-4187-496c-9304-baadb23ced91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4dea591b6494b93ab37d08cecf464a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e7080a3-fa33-4524-8fe2-a7f62bf215fd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:26Z,use_quota=True,user_id='2416c53fb2624b839b61b66279f4b86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcfe9cb-fd00-4049-a456-52f072572ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcfe9cb-fd00-4049-a456-52f072572ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea9156d-2b7a-4fc4-86bd-40dc3dc7a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea9156d-2b7a-4fc4-86bd-40dc3dc7a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a99170a0-4187-496c-9304-baadb23ced91', 'volume_name': 'volume-a99170a0-4187-496c-9304-baadb23ced91', 'volume_size': 1, 'snapshot_id': '1e7080a3-fa33-4524-8fe2-a7f62bf215fd'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ddb928-4718-41eb-9af4-fa23d1637110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ddb928-4718-41eb-9af4-fa23d1637110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba8b7fa-b750-40d8-8ce4-35119e3833e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:26 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Volume a99170a0-4187-496c-9304-baadb23ced91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a99170a0-4187-496c-9304-baadb23ced91', 'volume_size': 1, 'snapshot_id': '1e7080a3-fa33-4524-8fe2-a7f62bf215fd'}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-1e7080a3-fa33-4524-8fe2-a7f62bf215fd-a99170a0-4187-496c-9304-baadb23ced91" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-1e7080a3-fa33-4524-8fe2-a7f62bf215fd-a99170a0-4187-496c-9304-baadb23ced91" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Creating volume a99170a0-4187-496c-9304-baadb23ced91 from snapshot 1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-a99170a0-4187-496c-9304-baadb23ced91" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-a99170a0-4187-496c-9304-baadb23ced91" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] snapshot: 1e7080a3-fa33-4524-8fe2-a7f62bf215fd, volume: a99170a0-4187-496c-9304-baadb23ced91,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[01896034-d0ff-4b52-95ab-9be94045ebf9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:26 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd
Apr 09 10:45:26 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-32f58af4-067c-43e0-8bfc-931d19924d11 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0" by "attach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-32f58af4-067c-43e0-8bfc-931d19924d11 tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0" acquired by "attach_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-32f58af4-067c-43e0-8bfc-931d19924d11 tempest-VolumesActionsTest-1148795082 None] Attaching volume 85db5e68-1d79-4daf-bf05-758d883d3ec0 to instance 74cabae1-c615-43a8-a651-562fa2d55487 at mountpoint /dev/vdb on host None.
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-32f58af4-067c-43e0-8bfc-931d19924d11 tempest-VolumesActionsTest-1148795082 None] Attach volume completed successfully.
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-32f58af4-067c-43e0-8bfc-931d19924d11 tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0" released by "attach_volume" :: held 0.080s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "cinder-quobyte-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a4649-2968-4455-ac9f-6207ac63bd95]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:27 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60
Apr 09 10:45:27 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:27 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd" returned: 0 in 0.561s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[378be489-5212-4b97-a2cd-57943026551d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:27 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:27 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d3336b7-1758-4440-bd95-f8935088efbf tempest-VolumesActionsTest-1148795082 None] Acquiring lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-detach_volume" by "detach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d3336b7-1758-4440-bd95-f8935088efbf tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3d3336b7-1758-4440-bd95-f8935088efbf tempest-VolumesActionsTest-1148795082 None] Detaching volume 85db5e68-1d79-4daf-bf05-758d883d3ec0 from instance 74cabae1-c615-43a8-a651-562fa2d55487.
Apr 09 10:45:27 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3d3336b7-1758-4440-bd95-f8935088efbf tempest-VolumesActionsTest-1148795082 None] Detach volume completed successfully.
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3d3336b7-1758-4440-bd95-f8935088efbf tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:27 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60
Apr 09 10:45:27 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:27 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.532s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:45:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:27 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91
Apr 09 10:45:27 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:28 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" returned: 0 in 0.484s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-quobyte-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60" released by "delete_volume" :: held 1.058s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Created reservations ['7a618c14-2f47-4e16-9d47-58449122d5b8', '502c3ebb-129b-40ce-822f-7819952ec891', 'e4d62c25-b9e3-487e-9dfe-c1ada2b89697', '0d007414-e140-4909-b43c-b035ff1d711c'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:28 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:28 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:30 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 2.116s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:30 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:30 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Deleted volume successfully.
Apr 09 10:45:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bfaacd61-b646-49b1-8f24-31417bb84de5 tempest-VolumesDeleteCascade-1426491476 None] Lock "cinder-5f9c0d0d-bcc1-44bc-a5e8-bf04ce298d60-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:30 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91" returned: 0 in 2.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:30 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a187b731-7088-49b1-97a6-5dcd3da6e0bd]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:30 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:30 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:31 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.761s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:45:31 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Converted 1024.00 MB image at 405.15 MB/s
Apr 09 10:45:31 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 is being set with open permissions: ugo+rw
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:31 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91
Apr 09 10:45:31 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:31 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-a99170a0-4187-496c-9304-baadb23ced91" released by "_copy_volume_from_snapshot" :: held 4.947s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-1e7080a3-fa33-4524-8fe2-a7f62bf215fd-a99170a0-4187-496c-9304-baadb23ced91" released by "_create_volume_from_snapshot" :: held 4.969s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.983s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=170,cinder:INSERT=41,cinder:UPDATE=204,cinder:DELETE=16 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=189,cinder:INSERT=76,cinder:UPDATE=196,cinder:DELETE=19 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba8b7fa-b750-40d8-8ce4-35119e3833e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a99170a0-4187-496c-9304-baadb23ced91', 'volume_size': 1, 'snapshot_id': '1e7080a3-fa33-4524-8fe2-a7f62bf215fd'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e8f031-5e3e-461f-9434-b9b6fbeed99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:31 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Volume volume-a99170a0-4187-496c-9304-baadb23ced91 (a99170a0-4187-496c-9304-baadb23ced91): created successfully
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e8f031-5e3e-461f-9434-b9b6fbeed99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (aefa5d15-2dc7-46bb-a817-3c2d225cf067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4e3791b0-1d7b-4c07-b6e6-4a2f35f19f8a tempest-VolumeDependencyTests-384419835 None] Created volume successfully.
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Flow 'volume_create_manager' (99ea7360-097d-48d7-8074-2db2d72a4695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d2c208-4151-42b9-b30f-452fad45bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d2c208-4151-42b9-b30f-452fad45bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-921860323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80eabdb-2997-4ede-b7ce-02df92973603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e3b230893a4ae4a5112da5cab056dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:32Z,use_quota=True,user_id='0399ec7784fd4c5fa65c6ab0fa7e716e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74397fd5-6091-4a8f-9216-250cc7a2ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74397fd5-6091-4a8f-9216-250cc7a2ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29c9a2a-3b7f-496d-aa06-11a8588e7932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29c9a2a-3b7f-496d-aa06-11a8588e7932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f80eabdb-2997-4ede-b7ce-02df92973603', 'volume_name': 'volume-f80eabdb-2997-4ede-b7ce-02df92973603', 'volume_size': 2}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2187dbf-e4f6-4602-a376-b79367c59250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2187dbf-e4f6-4602-a376-b79367c59250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57d2793-d4ed-46e4-8736-dcfa684fda14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:31 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Volume f80eabdb-2997-4ede-b7ce-02df92973603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f80eabdb-2997-4ede-b7ce-02df92973603', 'volume_size': 2}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-921860323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80eabdb-2997-4ede-b7ce-02df92973603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e3b230893a4ae4a5112da5cab056dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:32Z,use_quota=True,user_id='0399ec7784fd4c5fa65c6ab0fa7e716e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Creating volume f80eabdb-2997-4ede-b7ce-02df92973603 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:31 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603 2147483648 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:31 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603 2147483648
Apr 09 10:45:31 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-1e7080a3-fa33-4524-8fe2-a7f62bf215fd-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-1e7080a3-fa33-4524-8fe2-a7f62bf215fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-1e7080a3-fa33-4524-8fe2-a7f62bf215fd" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-1e7080a3-fa33-4524-8fe2-a7f62bf215fd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Deleting offline snapshot 1e7080a3-fa33-4524-8fe2-a7f62bf215fd of volume ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] snapshot_file for this snap is: volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b269661f-d3df-4104-9ac4-ba5c9e15f21c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:32 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd
Apr 09 10:45:32 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:32 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603 2147483648" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:32 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603
Apr 09 10:45:32 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:32 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b3609-c39e-4c6a-9e01-a6055d640cda]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:32 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:32 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:32 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603" returned: 0 in 0.424s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57d2793-d4ed-46e4-8736-dcfa684fda14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80eabdb-2997-4ede-b7ce-02df92973603', 'volume_size': 2}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497e9800-74f7-4d63-9a9b-9d6e6777b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Volume volume-f80eabdb-2997-4ede-b7ce-02df92973603 (f80eabdb-2997-4ede-b7ce-02df92973603): created successfully
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497e9800-74f7-4d63-9a9b-9d6e6777b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Flow 'volume_create_manager' (99ea7360-097d-48d7-8074-2db2d72a4695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-30b6a7a0-f082-4c54-9b59-55ac79146d17 tempest-VolumesCloneNegativeTest-424007510 None] Created volume successfully.
Apr 09 10:45:33 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:33 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd
Apr 09 10:45:33 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:33 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:33 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd
Apr 09 10:45:33 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:33 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e.1e7080a3-fa33-4524-8fe2-a7f62bf215fd" returned: 0 in 0.426s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-1e7080a3-fa33-4524-8fe2-a7f62bf215fd" released by "_delete_snapshot" :: held 1.976s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" released by "delete_snapshot" :: held 1.988s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Created reservations ['74988286-6374-4cfe-8972-f90d79d9a382', 'e5825ecd-51d1-4339-a6ff-ac2ee4217932', 'de4f83d2-1bb0-41c4-adfd-3c15fefa5998', 'cad826fc-89ad-400a-a6b5-61a5cb6f80db'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Acquiring lock "cinder-f80eabdb-2997-4ede-b7ce-02df92973603-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Delete snapshot completed successfully.
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-48ab25ee-3e0f-4a9f-a42a-69cda2283f50 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-1e7080a3-fa33-4524-8fe2-a7f62bf215fd-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Lock "cinder-f80eabdb-2997-4ede-b7ce-02df92973603-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Acquiring lock "cinder-quobyte-f80eabdb-2997-4ede-b7ce-02df92973603" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Lock "cinder-quobyte-f80eabdb-2997-4ede-b7ce-02df92973603" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[02802432-614c-4a19-bab8-bc0d104d78f3]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:34 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603
Apr 09 10:45:34 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:34 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603" returned: 0 in 0.464s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:34 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603
Apr 09 10:45:34 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:35 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f80eabdb-2997-4ede-b7ce-02df92973603" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Lock "cinder-quobyte-f80eabdb-2997-4ede-b7ce-02df92973603" released by "delete_volume" :: held 0.922s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Created reservations ['d6fc428e-3413-4d45-a48a-1b1419fff12d', '03424baf-606d-41e5-bb72-bfb3b8af364c', 'ec033c12-ab4b-42c3-8287-5509df62f8c0', '512c33ba-9126-47c3-a67e-d8c2e6ed4038'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-ac6a0454-a83b-4c93-a684-9dbb49eaca6e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-ac6a0454-a83b-4c93-a684-9dbb49eaca6e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:35 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:35 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" acquired by "delete_volume" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[517b2b1d-d0f1-44ce-807e-8f84f865adb7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:35 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:35 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:35 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.593s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Deleted volume successfully.
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a45493ab-5dd6-489f-85d0-6e8b38ae42ee tempest-VolumesCloneNegativeTest-424007510 None] Lock "cinder-f80eabdb-2997-4ede-b7ce-02df92973603-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:35 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.676s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:35 devstack sudo[88786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e
Apr 09 10:45:35 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:36 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" returned: 0 in 0.461s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-ac6a0454-a83b-4c93-a684-9dbb49eaca6e" released by "delete_volume" :: held 1.182s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Created reservations ['726500c0-f934-4ea2-a37e-ba4a96f77749', '6e0b37d9-ea34-47dd-8434-673724e2a573', '3b89b378-4a5d-47fa-b61c-689faeee231e', '5fd3e569-6683-4b38-8209-832f87e01c45'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:36 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:36 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:36 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.505s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:36 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Deleted volume successfully.
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f76712f6-588e-44f7-9d6b-208b91cf2a67 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-ac6a0454-a83b-4c93-a684-9dbb49eaca6e-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Flow 'volume_create_manager' (9d06633b-2733-4d99-94f1-72e05d9ca5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfa970b-e851-4bcb-b9bb-d703bcd9c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfa970b-e851-4bcb-b9bb-d703bcd9c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-691811764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c5793-ecea-4d5a-8ac0-67b6496bff12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fb0709ed5d4d36bf312e756e4c7666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:37Z,use_quota=True,user_id='27a35b2f2a3542cea20d866a6bb6faac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77d4fd6-2dee-4be0-9bcc-f9f69a8845bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77d4fd6-2dee-4be0-9bcc-f9f69a8845bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4efe02-5a7d-43cf-9148-882d6032c19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.image.glance [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Creating Keystone auth plugin from conf {{(pid=82783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4efe02-5a7d-43cf-9148-882d6032c19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '775c5793-ecea-4d5a-8ac0-67b6496bff12', 'volume_name': 'volume-775c5793-ecea-4d5a-8ac0-67b6496bff12', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6957c69a80>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f05d2e-2a34-4d14-bb56-693c1e0e810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f05d2e-2a34-4d14-bb56-693c1e0e810d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717fd793-8df5-4534-b271-4c12983c5dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Volume 775c5793-ecea-4d5a-8ac0-67b6496bff12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-775c5793-ecea-4d5a-8ac0-67b6496bff12', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6957c69a80>}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Trying to clone 775c5793-ecea-4d5a-8ac0-67b6496bff12 from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]). {{(pid=82783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 10:45:37 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (2da8b0cf-7ba0-4a3c-8532-e56e517e8193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1411a589-ef18-429a-957b-749bdc7942c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1411a589-ef18-429a-957b-749bdc7942c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2024836911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d608ecce-1a7c-4300-88cc-b558d462a3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4dea591b6494b93ab37d08cecf464a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:38Z,use_quota=True,user_id='2416c53fb2624b839b61b66279f4b86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9b2bbe-a56e-41db-9ee6-cc1b85166320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9b2bbe-a56e-41db-9ee6-cc1b85166320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7e4f66-1031-47e7-9fba-866d79d886bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7e4f66-1031-47e7-9fba-866d79d886bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd608ecce-1a7c-4300-88cc-b558d462a3d8', 'volume_name': 'volume-d608ecce-1a7c-4300-88cc-b558d462a3d8', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f508498f-a400-49c3-8cdb-150a25dce6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f508498f-a400-49c3-8cdb-150a25dce6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4916b2e-1b06-4cd4-b85a-1c452023ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Volume d608ecce-1a7c-4300-88cc-b558d462a3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d608ecce-1a7c-4300-88cc-b558d462a3d8', 'volume_size': 1}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2024836911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d608ecce-1a7c-4300-88cc-b558d462a3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4dea591b6494b93ab37d08cecf464a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:38Z,use_quota=True,user_id='2416c53fb2624b839b61b66279f4b86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Creating volume d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:37 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db4b66-19fd-49aa-b1dc-70f5d0e6e662]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:37 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 1073741824
Apr 09 10:45:37 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:37 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD
Apr 09 10:45:37 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:38 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 is fetched for user 27a35b2f2a3542cea20d866a6bb6faac. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 10:45:38 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 1073741824" returned: 0 in 0.554s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[032dbf46-8d00-4466-aa96-b921a2e28596]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:38 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:38 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:38 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD
Apr 09 10:45:38 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:38 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.409s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4916b2e-1b06-4cd4-b85a-1c452023ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d608ecce-1a7c-4300-88cc-b558d462a3d8', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e41c4a-1a81-4e0a-a7e4-93e06c2b315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Volume volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 (d608ecce-1a7c-4300-88cc-b558d462a3d8): created successfully
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e41c4a-1a81-4e0a-a7e4-93e06c2b315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (2da8b0cf-7ba0-4a3c-8532-e56e517e8193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4ded5b55-7502-4787-b679-0bfdd434e376 tempest-VolumeDependencyTests-384419835 None] Created volume successfully.
Apr 09 10:45:38 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-691811764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c5793-ecea-4d5a-8ac0-67b6496bff12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fb0709ed5d4d36bf312e756e4c7666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:37Z,use_quota=True,user_id='27a35b2f2a3542cea20d866a6bb6faac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Creating volume 775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:38 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:38 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 1073741824
Apr 09 10:45:38 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:39 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 1073741824" returned: 0 in 0.505s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:39 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:39 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:39 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:39 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:39 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Attempting download of f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 775c5793-ecea-4d5a-8ac0-67b6496bff12. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd56b8-daa5-4b96-81f0-e4bc393c0bcb]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:39 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp
Apr 09 10:45:39 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (ebc70a2d-3025-418c-9a6b-812318a0dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc7c4f6-8712-47be-874a-ac1123695c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:39 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc7c4f6-8712-47be-874a-ac1123695c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1863341692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892883a2-b249-4be2-967f-eadd47d969aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4dea591b6494b93ab37d08cecf464a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d608ecce-1a7c-4300-88cc-b558d462a3d8,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:40Z,use_quota=True,user_id='2416c53fb2624b839b61b66279f4b86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1b47a4-0ea5-49a0-aeb5-f8f402eaf350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1b47a4-0ea5-49a0-aeb5-f8f402eaf350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df42ce71-bf7a-440e-8240-e7c5c2d179b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.470s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df42ce71-bf7a-440e-8240-e7c5c2d179b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '892883a2-b249-4be2-967f-eadd47d969aa', 'volume_name': 'volume-892883a2-b249-4be2-967f-eadd47d969aa', 'volume_size': 1, 'source_volid': 'd608ecce-1a7c-4300-88cc-b558d462a3d8', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca0b61e-47e8-4835-bc40-38708c6813b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca0b61e-47e8-4835-bc40-38708c6813b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb25f4b-16a8-4b80-a9eb-fb70870f7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:39 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Volume 892883a2-b249-4be2-967f-eadd47d969aa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-892883a2-b249-4be2-967f-eadd47d969aa', 'volume_size': 1, 'source_volid': 'd608ecce-1a7c-4300-88cc-b558d462a3d8', 'source_volstatus': 'available'}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:39 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Cloning volume d608ecce-1a7c-4300-88cc-b558d462a3d8 to volume 892883a2-b249-4be2-967f-eadd47d969aa
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Creating offline snapshot 089f1cc1-5cba-4cb1-a054-08b1cb1d936a of volume d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[880ffe1b-ec34-472c-b205-07d4a1ea74e0]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:40 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:40 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:40 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp" returned: 0 in 0.577s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:40 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp
Apr 09 10:45:40 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:40 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.576s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:40 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a 1G
Apr 09 10:45:40 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:40 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp" returned: 1 in 0.543s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4151152-a1b9-4cc0-94ca-126b9fa272f6_06def7dp' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea24117-4b4c-4aa1-9281-9dc5c2a29e3c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:40 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD
Apr 09 10:45:40 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:41 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a 1G" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:41 devstack sudo[88843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a
Apr 09 10:45:41 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:41 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] f4151152-a1b9-4cc0-94ca-126b9fa272f6 was qcow2, converting to raw {{(pid=82783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:41 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:41 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:41 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a" returned: 0 in 0.513s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:41 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a is being set with open permissions: ugo+rw
Apr 09 10:45:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:41 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a
Apr 09 10:45:41 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:42 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:42 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:42 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info
Apr 09 10:45:42 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 0 in 0.908s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4151152-a1b9-4cc0-94ca-126b9fa272f6_p0f6b28fdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:45:42 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Converted 112.00 MB image at 112.00 MB/s
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:42 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 1G
Apr 09 10:45:42 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:42 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info" returned: 0 in 0.461s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:42 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info is being set with open permissions: ugo+rw
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:42 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info
Apr 09 10:45:42 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:42 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 1G" returned: 0 in 0.481s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93d133-b3a6-4113-a872-0c7128cad652]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:42 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:42 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:43 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.info" returned: 0 in 0.417s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-892883a2-b249-4be2-967f-eadd47d969aa" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-892883a2-b249-4be2-967f-eadd47d969aa" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] snapshot: 089f1cc1-5cba-4cb1-a054-08b1cb1d936a, volume: 892883a2-b249-4be2-967f-eadd47d969aa,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c1204b-43d7-4969-afe9-3df07ba1a457]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:43 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a
Apr 09 10:45:43 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:43 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 0 in 0.486s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:43 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:43 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:43 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a" returned: 0 in 0.506s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d608ecce-1a7c-4300-88cc-b558d462a3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba328f4d-e43a-4908-bf81-4cd77733f0c2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:43 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:43 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:43 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 1 in 0.509s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Downloaded image f4151152-a1b9-4cc0-94ca-126b9fa272f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}])) to volume 775c5793-ecea-4d5a-8ac0-67b6496bff12 successfully. {{(pid=82783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Temporary image f4151152-a1b9-4cc0-94ca-126b9fa272f6 for user 27a35b2f2a3542cea20d866a6bb6faac is deleted. {{(pid=82783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.volume_utils [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Marking volume 775c5793-ecea-4d5a-8ac0-67b6496bff12 as bootable. {{(pid=82783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Copying metadata from image f4151152-a1b9-4cc0-94ca-126b9fa272f6 to 775c5793-ecea-4d5a-8ac0-67b6496bff12. {{(pid=82783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Creating volume glance metadata for volume 775c5793-ecea-4d5a-8ac0-67b6496bff12 backed by image f4151152-a1b9-4cc0-94ca-126b9fa272f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717fd793-8df5-4534-b271-4c12983c5dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775c5793-ecea-4d5a-8ac0-67b6496bff12', 'volume_size': 1, 'image_id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f694df109df34c6490757865895f2378', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4151152-a1b9-4cc0-94ca-126b9fa272f6', 'created_at': datetime.datetime(2026, 4, 9, 8, 35, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 8, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4151152-a1b9-4cc0-94ca-126b9fa272f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6957c69a80>}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27248c7-08c4-4e2a-b654-6b471857282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:43 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Volume volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 (775c5793-ecea-4d5a-8ac0-67b6496bff12): created successfully
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27248c7-08c4-4e2a-b654-6b471857282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:43 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Flow 'volume_create_manager' (9d06633b-2733-4d99-94f1-72e05d9ca5b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:43 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-692f1598-d6a9-4b14-92d8-2c16bfd8d3f1 tempest-VolumesExtendTest-737704566 None] Created volume successfully.
Apr 09 10:45:44 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:44 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:45:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:44 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa
Apr 09 10:45:44 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:46 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa" returned: 0 in 2.326s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d831f5-fc85-456f-b457-59318b8ec037]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:46 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:46 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:47 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.708s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:45:47 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Converted 1024.00 MB image at 439.99 MB/s
Apr 09 10:45:47 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa is being set with open permissions: ugo+rw
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:47 devstack sudo[88974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa
Apr 09 10:45:47 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:47 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa" returned: 0 in 0.522s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-892883a2-b249-4be2-967f-eadd47d969aa" released by "_copy_volume_from_snapshot" :: held 4.635s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-089f1cc1-5cba-4cb1-a054-08b1cb1d936a" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-089f1cc1-5cba-4cb1-a054-08b1cb1d936a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Deleting offline snapshot 089f1cc1-5cba-4cb1-a054-08b1cb1d936a of volume d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] snapshot_file for this snap is: volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f80732-2f3d-4040-ad14-1215e9e2dd54]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:47 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a
Apr 09 10:45:47 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:48 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a" returned: 0 in 0.496s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d608ecce-1a7c-4300-88cc-b558d462a3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:45:48 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e16838-108b-4ec6-b635-654cd06393b4]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:48 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:48 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:48 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.575s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:49 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a
Apr 09 10:45:49 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e9ae9411-e89b-44d5-bb88-45fd1a1bb4f1 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0" by "attach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e9ae9411-e89b-44d5-bb88-45fd1a1bb4f1 tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0" acquired by "attach_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e9ae9411-e89b-44d5-bb88-45fd1a1bb4f1 tempest-VolumesActionsTest-1148795082 None] Attaching volume 85db5e68-1d79-4daf-bf05-758d883d3ec0 to instance 76ec330c-a3a4-414a-89c2-d3fc92b11dcb at mountpoint /dev/vdb on host None.
Apr 09 10:45:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e9ae9411-e89b-44d5-bb88-45fd1a1bb4f1 tempest-VolumesActionsTest-1148795082 None] Attach volume completed successfully.
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e9ae9411-e89b-44d5-bb88-45fd1a1bb4f1 tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0" released by "attach_volume" :: held 0.054s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:49 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:49 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a
Apr 09 10:45:49 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bf7e295d-0411-4a3b-bd42-0f48f111a430 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-detach_volume" by "detach_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bf7e295d-0411-4a3b-bd42-0f48f111a430 tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-bf7e295d-0411-4a3b-bd42-0f48f111a430 tempest-VolumesActionsTest-1148795082 None] Detaching volume 85db5e68-1d79-4daf-bf05-758d883d3ec0 from instance 76ec330c-a3a4-414a-89c2-d3fc92b11dcb.
Apr 09 10:45:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-bf7e295d-0411-4a3b-bd42-0f48f111a430 tempest-VolumesActionsTest-1148795082 None] Detach volume completed successfully.
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bf7e295d-0411-4a3b-bd42-0f48f111a430 tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:49 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8.089f1cc1-5cba-4cb1-a054-08b1cb1d936a" returned: 0 in 0.501s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-089f1cc1-5cba-4cb1-a054-08b1cb1d936a" released by "_delete_snapshot" :: held 2.169s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.008s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.410s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb25f4b-16a8-4b80-a9eb-fb70870f7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892883a2-b249-4be2-967f-eadd47d969aa', 'volume_size': 1, 'source_volid': 'd608ecce-1a7c-4300-88cc-b558d462a3d8', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8f8221-29be-4bd5-869d-0bfbcf896a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6621059d-29ae-4801-81d3-9c667897ea30]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:50 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Volume volume-892883a2-b249-4be2-967f-eadd47d969aa (892883a2-b249-4be2-967f-eadd47d969aa): created successfully
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8f8221-29be-4bd5-869d-0bfbcf896a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Flow 'volume_create_manager' (ebc70a2d-3025-418c-9a6b-812318a0dc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:50 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a30b21a8-6c6f-4322-8a93-0fcd2ad2763d tempest-VolumeDependencyTests-384419835 None] Created volume successfully.
Apr 09 10:45:50 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:50 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:50 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 0 in 0.522s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:50 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:50 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-d608ecce-1a7c-4300-88cc-b558d462a3d8-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-d608ecce-1a7c-4300-88cc-b558d462a3d8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-d608ecce-1a7c-4300-88cc-b558d462a3d8" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-d608ecce-1a7c-4300-88cc-b558d462a3d8" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dded5a2-f1dc-4900-8859-d7e63b7e4ec9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:50 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:50 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:51 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 1 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 2G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 2G" returned: 0 in 0.051s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.152s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6195757a-7f6b-4f15-8358-b4cd30bfe3d8 tempest-VolumesExtendTest-737704566 None] Extend volume completed successfully.
Apr 09 10:45:51 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.470s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:51 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8
Apr 09 10:45:51 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:51 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-d608ecce-1a7c-4300-88cc-b558d462a3d8" returned: 0 in 0.503s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-d608ecce-1a7c-4300-88cc-b558d462a3d8" released by "delete_volume" :: held 1.053s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Created reservations ['0a44b3ae-2a17-4221-91f9-91974af23494', '3dec9a6a-507e-4b65-adae-9865f421cce4', 'ff83aa7f-ef31-4507-9de9-0014501d34cc', '070d9cbf-04e9-4596-aa90-db50f330a2e7'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:51 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:51 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-775c5793-ecea-4d5a-8ac0-67b6496bff12-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Lock "cinder-775c5793-ecea-4d5a-8ac0-67b6496bff12-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-quobyte-775c5793-ecea-4d5a-8ac0-67b6496bff12" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-775c5793-ecea-4d5a-8ac0-67b6496bff12" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:52 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0073954-9a22-47b5-9beb-06707bbc5763]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:52 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Deleted volume successfully.
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7e9256-f1e8-4f59-a49d-c816ba840f73 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-d608ecce-1a7c-4300-88cc-b558d462a3d8-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:52 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:52 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:52 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 0 in 0.491s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-892883a2-b249-4be2-967f-eadd47d969aa-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-892883a2-b249-4be2-967f-eadd47d969aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:52 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:52 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-892883a2-b249-4be2-967f-eadd47d969aa" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-892883a2-b249-4be2-967f-eadd47d969aa" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241b28f-b535-4e7c-b854-70a10d8662ab]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:52 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa
Apr 09 10:45:52 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:53 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 1 in 0.518s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:53 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12
Apr 09 10:45:53 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:53 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:53 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa
Apr 09 10:45:53 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:53 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-775c5793-ecea-4d5a-8ac0-67b6496bff12" returned: 0 in 0.424s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-775c5793-ecea-4d5a-8ac0-67b6496bff12" released by "delete_volume" :: held 1.476s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Created reservations ['70f8f341-eac6-4cb3-97da-7e89e9654c46', '5294f9e0-38fb-472d-9cb0-7d5fb0e2768f', '152f6fb2-9906-4bf7-b935-2848379a3c46', 'c4ec92b6-b1b2-4876-9e9f-945aed935177'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:53 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:53 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:53 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-892883a2-b249-4be2-967f-eadd47d969aa" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-892883a2-b249-4be2-967f-eadd47d969aa" released by "delete_volume" :: held 0.980s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Created reservations ['48c78ea6-5589-4a55-8294-5dfeb8e1cd78', '24a94766-3389-4e11-976c-ebfa1493c288', '016ffe3d-9ae9-4af4-9e97-d9c458806a46', '673a1f5a-9bd0-441e-81b0-e7af79c21ceb'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:53 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:53 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:54 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Deleted volume successfully.
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7c6ba1eb-4013-4369-abfc-1b3e2f177c26 tempest-VolumesExtendTest-737704566 None] Lock "cinder-775c5793-ecea-4d5a-8ac0-67b6496bff12-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:54 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Deleted volume successfully.
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1cdc5dcd-18b1-477b-b41f-f02e61314d20 tempest-VolumeDependencyTests-384419835 None] Lock "cinder-892883a2-b249-4be2-967f-eadd47d969aa-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Flow 'volume_create_manager' (2be19b33-ea0c-4c6f-95e6-a63b3232e46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9832096-410c-47db-9b43-1951a90c7a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9832096-410c-47db-9b43-1951a90c7a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1455596414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59600395-db33-40d8-ad89-3f040bdb0904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fb0709ed5d4d36bf312e756e4c7666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:55Z,use_quota=True,user_id='27a35b2f2a3542cea20d866a6bb6faac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0287b823-2e6d-4dbb-bf73-9a4bba673a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0287b823-2e6d-4dbb-bf73-9a4bba673a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acedec23-c409-42d9-95d5-8838e8a3643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acedec23-c409-42d9-95d5-8838e8a3643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59600395-db33-40d8-ad89-3f040bdb0904', 'volume_name': 'volume-59600395-db33-40d8-ad89-3f040bdb0904', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34954f1-db10-4b29-99db-f1f384cc57dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34954f1-db10-4b29-99db-f1f384cc57dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d65fa9d-c293-461e-8134-03b5a4691cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:54 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Volume 59600395-db33-40d8-ad89-3f040bdb0904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59600395-db33-40d8-ad89-3f040bdb0904', 'volume_size': 1}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1455596414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59600395-db33-40d8-ad89-3f040bdb0904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fb0709ed5d4d36bf312e756e4c7666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:45:55Z,use_quota=True,user_id='27a35b2f2a3542cea20d866a6bb6faac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Creating volume 59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:45:54 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:45:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:54 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 1073741824
Apr 09 10:45:54 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-a99170a0-4187-496c-9304-baadb23ced91-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Lock "cinder-a99170a0-4187-496c-9304-baadb23ced91-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Acquiring lock "cinder-quobyte-a99170a0-4187-496c-9304-baadb23ced91" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-a99170a0-4187-496c-9304-baadb23ced91" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee62680-7a61-404f-b897-765ec77b052d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:55 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91
Apr 09 10:45:55 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:55 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 1073741824" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:55 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904
Apr 09 10:45:55 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:55 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91" returned: 0 in 0.499s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:55 devstack sudo[89130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91
Apr 09 10:45:55 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:55 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d65fa9d-c293-461e-8134-03b5a4691cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59600395-db33-40d8-ad89-3f040bdb0904', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dffb70b-1bff-47be-a29d-0d065be78cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:45:55 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Volume volume-59600395-db33-40d8-ad89-3f040bdb0904 (59600395-db33-40d8-ad89-3f040bdb0904): created successfully
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dffb70b-1bff-47be-a29d-0d065be78cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:45:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Flow 'volume_create_manager' (2be19b33-ea0c-4c6f-95e6-a63b3232e46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:45:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8a1f4aea-6f46-4d44-af5a-fe54c683863a tempest-VolumesExtendTest-737704566 None] Created volume successfully.
Apr 09 10:45:56 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a99170a0-4187-496c-9304-baadb23ced91" returned: 0 in 0.421s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Lock "cinder-quobyte-a99170a0-4187-496c-9304-baadb23ced91" released by "delete_volume" :: held 0.941s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Created reservations ['af793f86-5bb6-4fc4-ae98-1b4d42e14e12', 'c25fdfbe-9a74-4c60-be0d-f33eaf60ac49', '39fdb264-20bb-4e3f-a2d5-e507d3a46337', '76460923-1b2d-44e8-bcca-ba147801d2c2'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:56 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:45:56 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:56 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:45:56 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Deleted volume successfully.
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-1b90eeb1-3dec-41bc-9298-5cac6cd1bf2e tempest-VolumeDependencyTests-384419835 None] Lock "cinder-a99170a0-4187-496c-9304-baadb23ced91-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Creating offline snapshot 7f02501b-e8f8-441b-8a94-0a9be2b39484 of volume 59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd04ff2-d6f4-4a39-9516-ea1d0b44a9af]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:56 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904
Apr 09 10:45:56 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:57 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904" returned: 0 in 0.510s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:57 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 1G
Apr 09 10:45:57 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:57 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 1G" returned: 0 in 0.519s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59600395-db33-40d8-ad89-3f040bdb0904 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:57 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59600395-db33-40d8-ad89-3f040bdb0904 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484
Apr 09 10:45:57 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:58 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59600395-db33-40d8-ad89-3f040bdb0904 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:58 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 is being set with open permissions: ugo+rw
Apr 09 10:45:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:58 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484
Apr 09 10:45:58 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:45:58 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:58 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info
Apr 09 10:45:58 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:59 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info" returned: 0 in 0.406s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:59 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info is being set with open permissions: ugo+rw
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:59 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info
Apr 09 10:45:59 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:45:59 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.info" returned: 0 in 0.403s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.014s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6187d6-311e-4a0c-8c6d-1bacafe27cc1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:45:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:45:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e425d1b9-f968-401d-ad00-35cd04f6d254 tempest-VolumesExtendTest-737704566 None] Create snapshot completed successfully
Apr 09 10:45:59 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:45:59 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:00 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:00 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[532d4ec6-5155-48ad-954c-7a0f070869fb]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:00 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:00 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:00 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.465s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.5a89591a-b35b-4cf1-a7f5-e445035b2dd0vfru8u0j.img {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:00 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.5a89591a-b35b-4cf1-a7f5-e445035b2dd0vfru8u0j.img
Apr 09 10:46:00 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:02 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.5a89591a-b35b-4cf1-a7f5-e445035b2dd0vfru8u0j.img" returned: 0 in 1.766s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab16998f-6966-4f2b-b689-2afd91fdfe74]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:02 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:02 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:02 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.588s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:03 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0, size 1024.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.5a89591a-b35b-4cf1-a7f5-e445035b2dd0vfru8u0j.img {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:46:03 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Converted 1024.00 MB image at 579.15 MB/s
Apr 09 10:46:03 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] 5a89591a-b35b-4cf1-a7f5-e445035b2dd0 was raw, no need to convert to raw {{(pid=82783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 09 10:46:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.047s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:12 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Uploaded volume to glance image-id: 5a89591a-b35b-4cf1-a7f5-e445035b2dd0. {{(pid=82783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 09 10:46:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.704s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:12 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb59aad2-99ce-43cb-bdb9-bd54c5f4bdf7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:12 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b08e2b98-c5c4-4ce4-91f6-715bbe299c36 tempest-VolumesActionsTest-1148795082 None] Copy volume to image completed successfully.
Apr 09 10:46:12 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904
Apr 09 10:46:12 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:13 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 2G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 2G" returned: 0 in 0.065s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.572s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f3e54c62-04c5-4a5e-9cf7-96c3f5245a3e tempest-VolumesExtendTest-737704566 None] Extend volume completed successfully.
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4364777e-3369-4d59-9751-434b928a4245]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:13 devstack sudo[89198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:13 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-7f02501b-e8f8-441b-8a94-0a9be2b39484-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Lock "cinder-7f02501b-e8f8-441b-8a94-0a9be2b39484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-quobyte-59600395-db33-40d8-ad89-3f040bdb0904" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:14 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-59600395-db33-40d8-ad89-3f040bdb0904" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-quobyte-7f02501b-e8f8-441b-8a94-0a9be2b39484" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-7f02501b-e8f8-441b-8a94-0a9be2b39484" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Deleting offline snapshot 7f02501b-e8f8-441b-8a94-0a9be2b39484 of volume 59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] snapshot_file for this snap is: volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1937805f-db70-4bd9-b649-8a934fb01a65]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fc2d62-6e8f-43e9-8012-90fc50df9851]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:14 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:14 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:14 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484
Apr 09 10:46:14 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:14 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.467s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:14 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img
Apr 09 10:46:14 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:14 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59600395-db33-40d8-ad89-3f040bdb0904(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab1a8c-e6fb-47c5-8c78-98c5a46df55e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:14 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904
Apr 09 10:46:14 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:15 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904" returned: 0 in 0.655s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:15 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484
Apr 09 10:46:15 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:16 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484" returned: 0 in 1.245s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:16 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484
Apr 09 10:46:16 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:16 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img" returned: 0 in 1.975s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a408262-a2a5-4267-a8fd-74fe17108b1c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:16 devstack sudo[89238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:16 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:16 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904.7f02501b-e8f8-441b-8a94-0a9be2b39484" returned: 0 in 0.414s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-7f02501b-e8f8-441b-8a94-0a9be2b39484" released by "_delete_snapshot" :: held 2.860s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-59600395-db33-40d8-ad89-3f040bdb0904" released by "delete_snapshot" :: held 2.872s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Created reservations ['dad52c03-89b6-45bd-9d5f-8fde8a4b91c6', '6f8b74de-3ecf-41c1-9835-a977f594af92', '8862e8f0-d4b4-4094-990c-545fee82d8eb', 'b0f7284c-689c-4a90-bb6f-1cdedf3e40e1'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Delete snapshot completed successfully.
Apr 09 10:46:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6dc434f0-03cc-48be-bee2-7846f2fdcf88 tempest-VolumesExtendTest-737704566 None] Lock "cinder-7f02501b-e8f8-441b-8a94-0a9be2b39484-delete_snapshot" released by "delete_snapshot" :: held 2.952s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:17 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.591s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:46:17 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Converted 1024.00 MB image at 518.07 MB/s
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] 3da1dc31-76d9-40e2-9166-fa3e1a535952 was raw, converting to qcow2 {{(pid=82783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9447ea-eafc-4861-827e-d1314461b40a]: (4, 'raw') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:17 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img
Apr 09 10:46:17 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-59600395-db33-40d8-ad89-3f040bdb0904-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Lock "cinder-59600395-db33-40d8-ad89-3f040bdb0904-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Acquiring lock "cinder-quobyte-59600395-db33-40d8-ad89-3f040bdb0904" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-59600395-db33-40d8-ad89-3f040bdb0904" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c481d22-3e32-400b-8a24-03c1643c47e6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:17 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904
Apr 09 10:46:17 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:17 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img" returned: 0 in 0.513s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:17 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img
Apr 09 10:46:17 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:17 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904" returned: 0 in 0.501s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:17 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904
Apr 09 10:46:17 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:18 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img" returned: 1 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img' failed. Not Retrying. {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img /opt/stack/data/cinder/conversion/vol_upload_hsljpkio {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:18 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img /opt/stack/data/cinder/conversion/vol_upload_hsljpkio
Apr 09 10:46:18 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:18 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-59600395-db33-40d8-ad89-3f040bdb0904" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Lock "cinder-quobyte-59600395-db33-40d8-ad89-3f040bdb0904" released by "delete_volume" :: held 0.996s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Created reservations ['5393ef06-1360-428c-922e-d06a8f09e0aa', '674a42a7-5d9f-44b6-aca8-99abb5ae114d', '099d080a-98f4-452a-ba50-9f1d1cff0ad6', '20bd28b6-a9f4-4444-a059-7841eaae2f76'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:18 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:18 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:18 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img /opt/stack/data/cinder/conversion/vol_upload_hsljpkio" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Image conversion details: src /opt/stack/data/cinder/conversion/85db5e68-1d79-4daf-bf05-758d883d3ec0.temp_image.3da1dc31-76d9-40e2-9166-fa3e1a535952vmptlz25.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hsljpkio {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:46:18 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1c4d75-93f5-4603-aa6e-9573056b12a5]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hsljpkio {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:18 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hsljpkio
Apr 09 10:46:18 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:18 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.427s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:18 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Deleted volume successfully.
Apr 09 10:46:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-84f9806d-5a66-4ca8-b27b-167ed989a8bb tempest-VolumesExtendTest-737704566 None] Lock "cinder-59600395-db33-40d8-ad89-3f040bdb0904-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:19 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hsljpkio" returned: 0 in 0.448s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.291s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Uploaded volume to glance image-id: 3da1dc31-76d9-40e2-9166-fa3e1a535952. {{(pid=82783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 09 10:46:19 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ef4fe27d-c421-45e2-a9dd-a1eca6967cb6 tempest-VolumesActionsTest-1148795082 None] Copy volume to image completed successfully.
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Acquiring lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Acquiring lock "cinder-quobyte-85db5e68-1d79-4daf-bf05-758d883d3ec0" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Lock "cinder-quobyte-85db5e68-1d79-4daf-bf05-758d883d3ec0" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b02023-fbe6-4def-b8f9-84c30266c919]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:21 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:21 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Flow 'volume_create_manager' (94fbe7cc-0f40-4909-b230-db7edf1cf314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcde977-6c2a-48ba-84b2-565d2c5610a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcde977-6c2a-48ba-84b2-565d2c5610a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1054748317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83a25df62af488c9ba9349b18b3738c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:21Z,use_quota=True,user_id='df3bfabcba024160b8395dc0e509db26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500cce63-fbcb-49e5-885e-c8a0fbe6ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500cce63-fbcb-49e5-885e-c8a0fbe6ce92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00265cd3-8125-448c-aae7-7cb5781f24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00265cd3-8125-448c-aae7-7cb5781f24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d', 'volume_name': 'volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286b7c53-1d5e-4548-8187-c52c703cb72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286b7c53-1d5e-4548-8187-c52c703cb72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e7b23e-c2be-4201-8750-d7d383d41f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Volume 5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d', 'volume_size': 1}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1054748317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83a25df62af488c9ba9349b18b3738c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:21Z,use_quota=True,user_id='df3bfabcba024160b8395dc0e509db26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Creating volume 5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:21 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:21 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d 1073741824
Apr 09 10:46:21 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:21 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.497s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:21 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0
Apr 09 10:46:21 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:21 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d 1073741824" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:21 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d
Apr 09 10:46:21 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:22 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-85db5e68-1d79-4daf-bf05-758d883d3ec0" returned: 0 in 0.426s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Lock "cinder-quobyte-85db5e68-1d79-4daf-bf05-758d883d3ec0" released by "delete_volume" :: held 0.946s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Created reservations ['2a0ca2af-bc90-4480-b4e0-4fd64b2317c1', 'bd78c43d-430a-4a73-98fb-07644e632563', 'b1ee20e0-138a-4259-a871-87db97807237', 'a4d645c4-48e5-4a53-ab80-44ce32bd3138'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:22 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:22 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:22 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d" returned: 0 in 0.423s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e7b23e-c2be-4201-8750-d7d383d41f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4fce4b-911d-42ee-a371-a46ee8f59ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:22 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Volume volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d (5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d): created successfully
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4fce4b-911d-42ee-a371-a46ee8f59ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Flow 'volume_create_manager' (94fbe7cc-0f40-4909-b230-db7edf1cf314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-134096e9-9e13-45a0-9bfe-98b499ca1a3e tempest-VolumesNegativeTest-1897968577 None] Created volume successfully.
Apr 09 10:46:22 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.488s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Deleted volume successfully.
Apr 09 10:46:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-9d494794-cdd9-496e-a225-e74e957af94e tempest-VolumesActionsTest-1148795082 None] Lock "cinder-85db5e68-1d79-4daf-bf05-758d883d3ec0-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (897ebb5f-64ce-4fc9-8bbc-c4be750da2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dc82b4-2f75-427b-83af-652aa9b2de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dc82b4-2f75-427b-83af-652aa9b2de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96788522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcf22e0-d8c6-4489-864e-a1d9a05e6530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:28Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c8076f-aa5b-4b2f-9980-c82c9cb43216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c8076f-aa5b-4b2f-9980-c82c9cb43216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae595dd8-c086-4a8c-89dc-0dccb83d1cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae595dd8-c086-4a8c-89dc-0dccb83d1cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcf22e0-d8c6-4489-864e-a1d9a05e6530', 'volume_name': 'volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4aec74-18e1-4bbb-8460-8d2ccec42fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4aec74-18e1-4bbb-8460-8d2ccec42fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d34669-32f3-4ebb-a8f0-62da3fd64ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:27 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume 9dcf22e0-d8c6-4489-864e-a1d9a05e6530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530', 'volume_size': 1}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96788522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcf22e0-d8c6-4489-864e-a1d9a05e6530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:28Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating volume 9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:27 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:27 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 1073741824
Apr 09 10:46:27 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:28 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 1073741824" returned: 0 in 0.511s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:28 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530
Apr 09 10:46:28 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:28 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d34669-32f3-4ebb-a8f0-62da3fd64ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88011900-a0ff-4525-967d-2aedb757d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:28 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 (9dcf22e0-d8c6-4489-864e-a1d9a05e6530): created successfully
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88011900-a0ff-4525-967d-2aedb757d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (897ebb5f-64ce-4fc9-8bbc-c4be750da2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:28 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0c2f6462-2c47-4e25-a658-878bc8b361ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created volume successfully.
Apr 09 10:46:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating offline snapshot 5c42142e-1a59-484b-a8ee-5316407c6cf5 of volume 9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:46:29 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db43b87-af50-430d-812d-3e5eb1c37d5a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:30 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530
Apr 09 10:46:30 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:30 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" returned: 0 in 0.513s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:30 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 1G
Apr 09 10:46:30 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:30 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 1G" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:31 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5
Apr 09 10:46:31 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:31 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5" returned: 0 in 0.449s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:31 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 is being set with open permissions: ugo+rw
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:31 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5
Apr 09 10:46:31 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:31 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:UPDATE=112,cinder:SELECT=98,cinder:INSERT=38,cinder:DELETE=6 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:DELETE=11,cinder:UPDATE=110,cinder:SELECT=91,cinder:INSERT=27 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:46:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:31 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info
Apr 09 10:46:31 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:32 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:32 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info is being set with open permissions: ugo+rw
Apr 09 10:46:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:32 devstack sudo[89349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info
Apr 09 10:46:32 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:32 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.info" returned: 0 in 0.434s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.820s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6dc70e44-e8f4-42a3-9c5d-e67591591f08 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Create snapshot completed successfully
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (591bfc33-9151-45c9-a83c-1c9a38e112b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bd8d39-76be-41a1-a08e-2d9b9b03c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bd8d39-76be-41a1-a08e-2d9b9b03c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710634362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfec5500-e899-4279-a77a-96c4f693c3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:33Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7ccbc6-beb3-4619-8b57-ec1bef18cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7ccbc6-beb3-4619-8b57-ec1bef18cca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a0cf65-72f4-4e19-90d4-0a50eb4dd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a0cf65-72f4-4e19-90d4-0a50eb4dd508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfec5500-e899-4279-a77a-96c4f693c3b1', 'volume_name': 'volume-bfec5500-e899-4279-a77a-96c4f693c3b1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3370529d-9367-43e1-af5f-2b62547596ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3370529d-9367-43e1-af5f-2b62547596ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1ce109-1687-472f-834f-bce3d181e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume bfec5500-e899-4279-a77a-96c4f693c3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfec5500-e899-4279-a77a-96c4f693c3b1', 'volume_size': 1}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710634362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfec5500-e899-4279-a77a-96c4f693c3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:33Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating volume bfec5500-e899-4279-a77a-96c4f693c3b1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:33 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:33 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1 1073741824
Apr 09 10:46:33 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (21c2aae9-c2fe-4753-a425-96a4c7346982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fced28ff-2d82-4f63-87bf-985fcea4f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fced28ff-2d82-4f63-87bf-985fcea4f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2106105532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e86b235-1394-4b2c-a83a-b2923f5b373a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:33Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190c6d68-b942-4148-b08d-ca89e55cfb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190c6d68-b942-4148-b08d-ca89e55cfb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b25c091-938a-4fe9-8751-1e8ccd298e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b25c091-938a-4fe9-8751-1e8ccd298e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e86b235-1394-4b2c-a83a-b2923f5b373a', 'volume_name': 'volume-0e86b235-1394-4b2c-a83a-b2923f5b373a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa282a0-aade-4f22-ab83-ee5abf7b8803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa282a0-aade-4f22-ab83-ee5abf7b8803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57982b90-3e73-4b5d-8434-724ed41cef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume 0e86b235-1394-4b2c-a83a-b2923f5b373a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e86b235-1394-4b2c-a83a-b2923f5b373a', 'volume_size': 1}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (e02642e9-cee6-4612-94ae-c121f4831f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcc21f8-aa4e-4136-aedd-9d7e3ec48340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcc21f8-aa4e-4136-aedd-9d7e3ec48340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602772189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50cca4-4f3e-43c8-bc27-82f74057225a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:34Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75259c1e-12a5-4473-9396-1caf8dda11a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75259c1e-12a5-4473-9396-1caf8dda11a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0bfdd2-00ad-4037-9bf5-9181e48ee9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0bfdd2-00ad-4037-9bf5-9181e48ee9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a50cca4-4f3e-43c8-bc27-82f74057225a', 'volume_name': 'volume-9a50cca4-4f3e-43c8-bc27-82f74057225a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046f9552-6667-48db-ab43-f96b137ed0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046f9552-6667-48db-ab43-f96b137ed0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f240e3-7fa6-40f6-bc99-4d4173b14c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume 9a50cca4-4f3e-43c8-bc27-82f74057225a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a50cca4-4f3e-43c8-bc27-82f74057225a', 'volume_size': 1}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (211f89d3-0585-43cc-ab59-43ed6e70df67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598ebfb9-13bc-46ea-a38b-c995389fd6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598ebfb9-13bc-46ea-a38b-c995389fd6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1876520992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd97c4d-ef73-4c84-bc7c-91df4e6736b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:34Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e4ddd-29f3-4c3c-bb40-95a2ea1ddc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e4ddd-29f3-4c3c-bb40-95a2ea1ddc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e164b1-6d63-4bd8-8dae-0b5da9ba7ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e164b1-6d63-4bd8-8dae-0b5da9ba7ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd97c4d-ef73-4c84-bc7c-91df4e6736b1', 'volume_name': 'volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0be60-de5d-408f-9ff5-b2f2c9b414a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0be60-de5d-408f-9ff5-b2f2c9b414a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42662fd4-f159-4f5b-8c90-b96f31cf0d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume 4bd97c4d-ef73-4c84-bc7c-91df4e6736b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1', 'volume_size': 1}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:33 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1 1073741824" returned: 0 in 0.605s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:33 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1
Apr 09 10:46:33 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (2d6a5b73-22b3-4a49-916d-5b9bf64384b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4a7414-e434-4fd8-ab6c-90d462b32dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4a7414-e434-4fd8-ab6c-90d462b32dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635949010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2fa643-a313-4816-b2f5-fe72e295378c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:34Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fff0bff-d209-4dff-b13f-b2be48471bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fff0bff-d209-4dff-b13f-b2be48471bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7091e6-4d8b-4780-998a-ef68c7df072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7091e6-4d8b-4780-998a-ef68c7df072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2fa643-a313-4816-b2f5-fe72e295378c', 'volume_name': 'volume-ad2fa643-a313-4816-b2f5-fe72e295378c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6464ab38-f696-4698-aa88-ac816091ab12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6464ab38-f696-4698-aa88-ac816091ab12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee93ebb-bdd7-4d6b-bc25-ab400e3502ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume ad2fa643-a313-4816-b2f5-fe72e295378c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2fa643-a313-4816-b2f5-fe72e295378c', 'volume_size': 1}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:34 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.973s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2106105532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e86b235-1394-4b2c-a83a-b2923f5b373a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:33Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating volume 0e86b235-1394-4b2c-a83a-b2923f5b373a {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:34 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:34 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a 1073741824
Apr 09 10:46:34 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1ce109-1687-472f-834f-bce3d181e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfec5500-e899-4279-a77a-96c4f693c3b1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38bc18f-4a73-4d4a-a3ce-40a6e5ca9da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume volume-bfec5500-e899-4279-a77a-96c4f693c3b1 (bfec5500-e899-4279-a77a-96c4f693c3b1): created successfully
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38bc18f-4a73-4d4a-a3ce-40a6e5ca9da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (591bfc33-9151-45c9-a83c-1c9a38e112b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4fd579d7-a8c2-4ba0-ab21-f092e7e92e55 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created volume successfully.
Apr 09 10:46:35 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a 1073741824" returned: 0 in 0.565s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:35 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a
Apr 09 10:46:35 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:35 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a" returned: 0 in 0.450s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.852s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602772189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50cca4-4f3e-43c8-bc27-82f74057225a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:34Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating volume 9a50cca4-4f3e-43c8-bc27-82f74057225a {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:35 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57982b90-3e73-4b5d-8434-724ed41cef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e86b235-1394-4b2c-a83a-b2923f5b373a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db9ec5-8b1c-46a1-93a2-b1894fb509fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:35 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a 1073741824
Apr 09 10:46:35 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:35 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume volume-0e86b235-1394-4b2c-a83a-b2923f5b373a (0e86b235-1394-4b2c-a83a-b2923f5b373a): created successfully
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db9ec5-8b1c-46a1-93a2-b1894fb509fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (21c2aae9-c2fe-4753-a425-96a4c7346982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c727f632-4bc4-4203-b2cb-c16ea4913bba tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created volume successfully.
Apr 09 10:46:36 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a 1073741824" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:36 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a
Apr 09 10:46:36 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:36 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a" returned: 0 in 0.452s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.628s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1876520992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd97c4d-ef73-4c84-bc7c-91df4e6736b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:34Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating volume 4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:36 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f240e3-7fa6-40f6-bc99-4d4173b14c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a50cca4-4f3e-43c8-bc27-82f74057225a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5860564f-36ff-49c1-8cfa-645e5ec48ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:36 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 1073741824
Apr 09 10:46:36 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:36 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume volume-9a50cca4-4f3e-43c8-bc27-82f74057225a (9a50cca4-4f3e-43c8-bc27-82f74057225a): created successfully
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5860564f-36ff-49c1-8cfa-645e5ec48ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (e02642e9-cee6-4612-94ae-c121f4831f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-393f3614-d59d-4275-9bde-a892a27035c7 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created volume successfully.
Apr 09 10:46:37 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 1073741824" returned: 0 in 0.593s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:37 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1
Apr 09 10:46:37 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:37 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635949010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2fa643-a313-4816-b2f5-fe72e295378c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4441a8f274e76a3890842cfd184b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:34Z,use_quota=True,user_id='bb3bb08e4eb24320809c682c9cd7024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Creating volume ad2fa643-a313-4816-b2f5-fe72e295378c {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:37 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42662fd4-f159-4f5b-8c90-b96f31cf0d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:37 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c 1073741824
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc26aa0-25cf-4639-9fe1-1d554298962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:37 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 (4bd97c4d-ef73-4c84-bc7c-91df4e6736b1): created successfully
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc26aa0-25cf-4639-9fe1-1d554298962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (211f89d3-0585-43cc-ab59-43ed6e70df67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5eb6ec8b-3737-44b1-9fd6-d626ef0eda64 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created volume successfully.
Apr 09 10:46:38 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c 1073741824" returned: 0 in 0.540s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:38 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c
Apr 09 10:46:38 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:38 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c" returned: 0 in 0.486s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee93ebb-bdd7-4d6b-bc25-ab400e3502ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2fa643-a313-4816-b2f5-fe72e295378c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5577515f-e0df-486b-9b31-0fac9273b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Volume volume-ad2fa643-a313-4816-b2f5-fe72e295378c (ad2fa643-a313-4816-b2f5-fe72e295378c): created successfully
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5577515f-e0df-486b-9b31-0fac9273b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Flow 'volume_create_manager' (2d6a5b73-22b3-4a49-916d-5b9bf64384b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a7afb32f-4b91-4155-80c0-9186ec6f55f3 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created volume successfully.
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:39 devstack sudo[89451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:39 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-ad2fa643-a313-4816-b2f5-fe72e295378c-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-ad2fa643-a313-4816-b2f5-fe72e295378c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-ad2fa643-a313-4816-b2f5-fe72e295378c" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-ad2fa643-a313-4816-b2f5-fe72e295378c" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02ece9-f8d6-4d32-86e3-157526e8abb5]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:39 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c
Apr 09 10:46:39 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:40 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:40 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c" returned: 0 in 0.525s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:40 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c
Apr 09 10:46:40 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:40 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ad2fa643-a313-4816-b2f5-fe72e295378c" returned: 0 in 0.411s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-ad2fa643-a313-4816-b2f5-fe72e295378c" released by "delete_volume" :: held 0.984s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['43d2206a-a54c-4bf0-9144-ef5a3a0827c9', 'd20d1ee4-6bd8-421a-9533-b84fbcd3dcb4', 'e45e7acf-57b7-4a5e-8d48-6f93b2e3b66a', 'c02d113b-f846-4d34-a23d-f589cff5641c'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:40 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:40 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aaaaec-888b-48f4-8f2a-ddc391a509a6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:40 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1
Apr 09 10:46:40 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:41 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.454s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleted volume successfully.
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58bc90ba-f5f0-451f-8882-a3c301222d78 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-ad2fa643-a313-4816-b2f5-fe72e295378c-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:41 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1" returned: 0 in 0.507s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:41 devstack sudo[89471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1
Apr 09 10:46:41 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:41 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1" returned: 0 in 0.421s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1" released by "delete_volume" :: held 0.954s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['65dc65fd-0396-4890-ba9a-d50dc0295ef7', 'd581ecfe-9d2b-459f-ba0a-a39a22b7676d', '0fa722c1-30b2-466c-83e5-2070aad5747f', '5c705dfd-21ad-4816-9ab7-1219f415392d'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:41 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:41 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-9a50cca4-4f3e-43c8-bc27-82f74057225a-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-9a50cca4-4f3e-43c8-bc27-82f74057225a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-9a50cca4-4f3e-43c8-bc27-82f74057225a" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-9a50cca4-4f3e-43c8-bc27-82f74057225a" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8695cfd5-564b-4f08-9a6c-a9a64fa8907b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:42 devstack sudo[89476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a
Apr 09 10:46:42 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:42 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:42 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleted volume successfully.
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-619ddf8f-0062-4d8f-a88d-9e133c545df6 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-4bd97c4d-ef73-4c84-bc7c-91df4e6736b1-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:42 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a" returned: 0 in 0.487s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:42 devstack sudo[89483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a
Apr 09 10:46:42 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:42 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9a50cca4-4f3e-43c8-bc27-82f74057225a" returned: 0 in 0.415s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-9a50cca4-4f3e-43c8-bc27-82f74057225a" released by "delete_volume" :: held 0.922s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['581edb8e-08e9-4372-8c17-f0400f9260be', '6a683503-17de-4e56-a7b4-480f497b8bae', 'ade2519c-a0cc-44da-9150-582dd85a7389', 'bff36111-bbf2-431d-bed0-591f5fcfd760'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:42 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:42 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-0e86b235-1394-4b2c-a83a-b2923f5b373a-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-0e86b235-1394-4b2c-a83a-b2923f5b373a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-0e86b235-1394-4b2c-a83a-b2923f5b373a" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-0e86b235-1394-4b2c-a83a-b2923f5b373a" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d64b5-66ed-457b-b551-16bcd33785b2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:43 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a
Apr 09 10:46:43 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:43 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.494s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:43 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleted volume successfully.
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0c7a7327-27a8-4444-8b5a-ae18896a3378 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-9a50cca4-4f3e-43c8-bc27-82f74057225a-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:43 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a" returned: 0 in 0.541s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:43 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a
Apr 09 10:46:43 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:44 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0e86b235-1394-4b2c-a83a-b2923f5b373a" returned: 0 in 0.496s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-0e86b235-1394-4b2c-a83a-b2923f5b373a" released by "delete_volume" :: held 1.062s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['65f298fb-7bc1-4afc-b579-e5a464873d8f', 'a710792c-3a9a-431c-a865-10f0665d5887', '3ec8984a-a0e8-4ac0-8a5b-ee155f882803', '6da7e018-797a-44fa-9242-c911e913f097'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:44 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:44 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:44 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.443s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:44 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleted volume successfully.
Apr 09 10:46:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c4bb4cca-ceb8-41dd-956c-d7de8c1940b9 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-0e86b235-1394-4b2c-a83a-b2923f5b373a-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-bfec5500-e899-4279-a77a-96c4f693c3b1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-bfec5500-e899-4279-a77a-96c4f693c3b1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-bfec5500-e899-4279-a77a-96c4f693c3b1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-bfec5500-e899-4279-a77a-96c4f693c3b1" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166d89e-28a2-4053-ad4a-526edd1a77ff]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:45 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1
Apr 09 10:46:45 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:45 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1" returned: 0 in 0.507s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:45 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1
Apr 09 10:46:45 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:46 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bfec5500-e899-4279-a77a-96c4f693c3b1" returned: 0 in 0.449s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-bfec5500-e899-4279-a77a-96c4f693c3b1" released by "delete_volume" :: held 0.983s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['096cb083-a480-4e64-b45d-8adc4f3321fb', '64e33227-d60c-4213-a2e0-b6e0b733cbf0', '9b7f7341-565a-4539-98da-99b10d0fa91c', '5443118e-7ef5-42a1-bb7a-224c7eaa1645'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:46 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:46 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:46 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.458s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleted volume successfully.
Apr 09 10:46:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7ae189eb-864c-48f5-b8e3-24d6277d5d69 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-bfec5500-e899-4279-a77a-96c4f693c3b1-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Acquiring lock "cinder-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Lock "cinder-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Acquiring lock "cinder-quobyte-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Lock "cinder-quobyte-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f291e1a-ab99-4513-b1f2-26d0fe0ba9a2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:47 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d
Apr 09 10:46:47 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-5c42142e-1a59-484b-a8ee-5316407c6cf5-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-5c42142e-1a59-484b-a8ee-5316407c6cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-5c42142e-1a59-484b-a8ee-5316407c6cf5" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-5c42142e-1a59-484b-a8ee-5316407c6cf5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleting offline snapshot 5c42142e-1a59-484b-a8ee-5316407c6cf5 of volume 9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] snapshot_file for this snap is: volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae78d9f-a414-4dc6-ad97-d996cb1d7c3f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:47 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5
Apr 09 10:46:47 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:47 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d" returned: 0 in 0.520s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:47 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d
Apr 09 10:46:47 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:47 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192eabf-aed8-497a-96d8-fc6aa3fb8fd6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:48 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530
Apr 09 10:46:48 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:48 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Lock "cinder-quobyte-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d" released by "delete_volume" :: held 0.978s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Created reservations ['f59d9eeb-98d8-423c-99f7-92aab27c940b', '2179fbbe-afdd-44b1-a91f-269cbc7166b0', '1e3334e7-57e5-4c77-840f-ca559bd67b6c', 'f2b2a5fb-26da-4618-8ed1-3c00f9ff7712'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:48 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:48 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:48 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" returned: 0 in 0.566s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:48 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5
Apr 09 10:46:48 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:48 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.471s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Deleted volume successfully.
Apr 09 10:46:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3a47986b-80f2-44a7-a034-bc4e7cb7ed0a tempest-VolumesNegativeTest-1897968577 None] Lock "cinder-5ce4f336-2aa9-4f5e-afa2-976bb18e2c2d-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:49 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:49 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5
Apr 09 10:46:49 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:49 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530.5c42142e-1a59-484b-a8ee-5316407c6cf5" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-5c42142e-1a59-484b-a8ee-5316407c6cf5" released by "_delete_snapshot" :: held 2.077s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" released by "delete_snapshot" :: held 2.091s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['20226626-75a5-4a94-af20-715e36a5756d', '611c53bd-9300-4a88-9300-20af4e7f852e', '25b4afc2-120b-4549-b07d-4d48ac0808c0', '349e29d4-b5e2-4939-a601-001b0fb733db'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Delete snapshot completed successfully.
Apr 09 10:46:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-83e0aa81-f498-4bf3-b497-07531de61107 tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-5c42142e-1a59-484b-a8ee-5316407c6cf5-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-9dcf22e0-d8c6-4489-864e-a1d9a05e6530-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-9dcf22e0-d8c6-4489-864e-a1d9a05e6530-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "cinder-quobyte-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:46:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:46:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a73eb-bbfb-4a95-9d37-dea50493d55c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:50 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530
Apr 09 10:46:50 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:51 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" returned: 0 in 0.515s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:51 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530
Apr 09 10:46:51 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:51 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-quobyte-9dcf22e0-d8c6-4489-864e-a1d9a05e6530" released by "delete_volume" :: held 0.983s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Created reservations ['7cb1664f-8c7a-44da-9914-a4cb63f7c381', '87fb59d0-d052-44dd-9e14-b2cfc3cb102e', '04405354-9f10-4927-a4a9-d184d1f92630', '5b91a3b3-7081-4086-8a62-a67be633850e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:51 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:46:51 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:52 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:52 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:46:52 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Deleted volume successfully.
Apr 09 10:46:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-cd6406aa-6033-43f0-83b7-f0736b2d38ea tempest-CreateVolumesFromSnapshotTest-1697457137 None] Lock "cinder-9dcf22e0-d8c6-4489-864e-a1d9a05e6530-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (44cd7346-f16f-49bb-97b2-329465f68c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13675b8c-2d7b-4a75-bed0-f437cc056cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13675b8c-2d7b-4a75-bed0-f437cc056cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1152218634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14287332-02c6-4645-9c4e-08ab30c3ca0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:55Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337f4955-247b-4f9a-91c5-f691b047f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337f4955-247b-4f9a-91c5-f691b047f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71d3355-019d-4d3f-b20d-7215bf32c724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71d3355-019d-4d3f-b20d-7215bf32c724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14287332-02c6-4645-9c4e-08ab30c3ca0a', 'volume_name': 'volume-14287332-02c6-4645-9c4e-08ab30c3ca0a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ceb079-98f5-47f4-b415-321f8911d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ceb079-98f5-47f4-b415-321f8911d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e731f4a6-2134-40ea-93a1-56fa1444c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:55 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume 14287332-02c6-4645-9c4e-08ab30c3ca0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14287332-02c6-4645-9c4e-08ab30c3ca0a', 'volume_size': 1}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1152218634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14287332-02c6-4645-9c4e-08ab30c3ca0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:46:55Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Creating volume 14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:46:55 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:46:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:55 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a 1073741824
Apr 09 10:46:55 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:56 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a 1073741824" returned: 0 in 0.511s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:56 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a
Apr 09 10:46:56 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:56 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a" returned: 0 in 0.453s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e731f4a6-2134-40ea-93a1-56fa1444c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14287332-02c6-4645-9c4e-08ab30c3ca0a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc328d1-f896-42df-a2b8-872c17e93e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:46:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume volume-14287332-02c6-4645-9c4e-08ab30c3ca0a (14287332-02c6-4645-9c4e-08ab30c3ca0a): created successfully
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc328d1-f896-42df-a2b8-872c17e93e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:46:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (44cd7346-f16f-49bb-97b2-329465f68c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:46:56 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-de5a5d3c-51a4-4dde-b835-b76498e876b2 tempest-VolumesSnapshotTestJSON-1311983491 None] Created volume successfully.
Apr 09 10:46:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:46:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:46:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Creating offline snapshot 68ee63cf-bf6b-437f-ba8e-924b67f5e74a of volume 14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:46:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b467b4-07d8-4883-bd87-4d28ae639782]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:46:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:57 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a
Apr 09 10:46:57 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:58 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a" returned: 0 in 0.565s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:58 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a 1G
Apr 09 10:46:58 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:58 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a 1G" returned: 0 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14287332-02c6-4645-9c4e-08ab30c3ca0a -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:58 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14287332-02c6-4645-9c4e-08ab30c3ca0a -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a
Apr 09 10:46:58 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:59 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14287332-02c6-4645-9c4e-08ab30c3ca0a -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a" returned: 0 in 0.528s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:59 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a is being set with open permissions: ugo+rw
Apr 09 10:46:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:59 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a
Apr 09 10:46:59 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:46:59 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 09 10:46:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:46:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:46:59 devstack sudo[89621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info
Apr 09 10:46:59 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:00 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info" returned: 0 in 0.437s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:00 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info is being set with open permissions: ugo+rw
Apr 09 10:47:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:00 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info
Apr 09 10:47:00 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:00 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.info" returned: 0 in 0.499s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.085s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:00 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3d57ed36-9dd8-4920-935b-9b87c61a5c7e tempest-VolumesSnapshotTestJSON-1311983491 None] Create snapshot completed successfully
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-68ee63cf-bf6b-437f-ba8e-924b67f5e74a-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-68ee63cf-bf6b-437f-ba8e-924b67f5e74a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-14287332-02c6-4645-9c4e-08ab30c3ca0a" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-14287332-02c6-4645-9c4e-08ab30c3ca0a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-68ee63cf-bf6b-437f-ba8e-924b67f5e74a" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-68ee63cf-bf6b-437f-ba8e-924b67f5e74a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleting offline snapshot 68ee63cf-bf6b-437f-ba8e-924b67f5e74a of volume 14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] snapshot_file for this snap is: volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbc3121-2353-42a3-8a39-acbe8112c205]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:02 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a
Apr 09 10:47:02 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:02 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a" returned: 0 in 0.546s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14287332-02c6-4645-9c4e-08ab30c3ca0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf35e06-d429-4450-9b32-d54a0d14b382]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:02 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a
Apr 09 10:47:02 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:03 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:03 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a
Apr 09 10:47:03 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:03 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a" returned: 0 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:03 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a
Apr 09 10:47:03 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:04 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a.68ee63cf-bf6b-437f-ba8e-924b67f5e74a" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-68ee63cf-bf6b-437f-ba8e-924b67f5e74a" released by "_delete_snapshot" :: held 2.126s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-14287332-02c6-4645-9c4e-08ab30c3ca0a" released by "delete_snapshot" :: held 2.141s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:04 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['65dd278a-06f5-4593-a1cf-14fcd68ce8e3', '6cb0d07b-9489-4daf-b597-65f195d6f978', '4049bc7b-9b9e-424d-90b6-f1ba1fa235b3', 'e3c6ad21-2b2f-4fb2-9553-31ecfaf41466'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:04 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Delete snapshot completed successfully.
Apr 09 10:47:04 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-875a5d52-57e4-412c-9053-e93dd2cb0760 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-68ee63cf-bf6b-437f-ba8e-924b67f5e74a-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (2d4e33bd-aa46-400d-a030-52c03b886792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6516219-ca7e-43fe-ac4e-fd126e71750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6516219-ca7e-43fe-ac4e-fd126e71750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916321989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7dc1bb-961b-4242-be4e-ab06dfb92f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:06Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64810ec-4304-4787-9668-b7117aeb5bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64810ec-4304-4787-9668-b7117aeb5bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c276e1a-98ef-4a92-8524-e1afb50cfd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c276e1a-98ef-4a92-8524-e1afb50cfd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7dc1bb-961b-4242-be4e-ab06dfb92f08', 'volume_name': 'volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d259332b-c6e4-4891-ba81-f4ac5f88ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d259332b-c6e4-4891-ba81-f4ac5f88ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74039262-9d78-4b24-a200-f1100fd89ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:05 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Volume db7dc1bb-961b-4242-be4e-ab06dfb92f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08', 'volume_size': 1}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916321989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7dc1bb-961b-4242-be4e-ab06dfb92f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:06Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Creating volume db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:05 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:05 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 1073741824
Apr 09 10:47:05 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:06 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 1073741824" returned: 0 in 0.526s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:06 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:06 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:06 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.496s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74039262-9d78-4b24-a200-f1100fd89ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e82f54-f2a6-4bc1-9698-b0c6751f4c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Volume volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 (db7dc1bb-961b-4242-be4e-ab06dfb92f08): created successfully
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e82f54-f2a6-4bc1-9698-b0c6751f4c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (2d4e33bd-aa46-400d-a030-52c03b886792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:06 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-58c32bd0-9edf-4df2-a605-5ff9b507760e tempest-VolumesSnapshotTestJSON-1311983491 None] Created volume successfully.
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Flow 'volume_create_manager' (4a05a246-8a62-4ef6-820e-420ce4a5cef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e88309-3d88-4e8e-895d-bc0b389e5556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e88309-3d88-4e8e-895d-bc0b389e5556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1081646841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522a5754-1979-4744-8701-9354cc41c60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca2a904a5104077b7265aaa135282ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:07Z,use_quota=True,user_id='c6f51fc413b54608800c55180b2f6c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275fea12-449c-418b-b404-c98df496fbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275fea12-449c-418b-b404-c98df496fbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e797b5-558a-4a21-8cbe-3b162b0287e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e797b5-558a-4a21-8cbe-3b162b0287e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522a5754-1979-4744-8701-9354cc41c60b', 'volume_name': 'volume-522a5754-1979-4744-8701-9354cc41c60b', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7164b1-67c9-4945-9c99-6d3193fdb180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7164b1-67c9-4945-9c99-6d3193fdb180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0636aa47-eca0-45ab-a7fc-28d08fc232ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:07 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Volume 522a5754-1979-4744-8701-9354cc41c60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522a5754-1979-4744-8701-9354cc41c60b', 'volume_size': 1}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1081646841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522a5754-1979-4744-8701-9354cc41c60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca2a904a5104077b7265aaa135282ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:07Z,use_quota=True,user_id='c6f51fc413b54608800c55180b2f6c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Creating volume 522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:07 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:07 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b 1073741824
Apr 09 10:47:07 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:07 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b 1073741824" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:07 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:07 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:08 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.446s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.263s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0636aa47-eca0-45ab-a7fc-28d08fc232ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522a5754-1979-4744-8701-9354cc41c60b', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04147914-456d-481c-a013-1d3809304639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Creating offline snapshot 51eddb06-0710-4b67-b608-53a69b8a2368 of volume db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:47:08 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Volume volume-522a5754-1979-4744-8701-9354cc41c60b (522a5754-1979-4744-8701-9354cc41c60b): created successfully
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04147914-456d-481c-a013-1d3809304639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Flow 'volume_create_manager' (4a05a246-8a62-4ef6-820e-420ce4a5cef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d68e9-4143-4edd-92a6-b60e04105af6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-1cceb1bf-2a9c-4152-be6a-944e21576dd1 tempest-SnapshotDependencyTests-1112461684 None] Created volume successfully.
Apr 09 10:47:08 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:08 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:08 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:08 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 1G
Apr 09 10:47:08 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:09 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 1G" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:09 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368
Apr 09 10:47:09 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:09 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:09 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 is being set with open permissions: ugo+rw
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:09 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368
Apr 09 10:47:09 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:09 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368" returned: 0 in 0.427s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:09 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info
Apr 09 10:47:09 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:10 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info" returned: 0 in 0.423s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:10 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info is being set with open permissions: ugo+rw
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:10 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info
Apr 09 10:47:10 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:10 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.info" returned: 0 in 0.407s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.585s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Creating offline snapshot 030f754e-a09e-4b7d-aec4-3c5cfed99e65 of volume 522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:47:10 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fa4ccb5c-03ad-4408-9934-9c356821aec6 tempest-VolumesSnapshotTestJSON-1311983491 None] Create snapshot completed successfully
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fabf44-26a8-4b4c-a15a-b1c42de2271b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:10 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:10 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (9c9dd77f-039a-439b-b66f-252f7d20fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb040c-ff55-40ae-a9ce-511ba896b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb040c-ff55-40ae-a9ce-511ba896b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2009368176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057c8028-0a21-4b75-afb1-1cdb91fd9b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=51eddb06-0710-4b67-b608-53a69b8a2368,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:11Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f281d0ac-d6ed-423c-b95a-30f7d443d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f281d0ac-d6ed-423c-b95a-30f7d443d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da5fec1-abc6-40c4-880f-4d7754aff8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da5fec1-abc6-40c4-880f-4d7754aff8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '057c8028-0a21-4b75-afb1-1cdb91fd9b59', 'volume_name': 'volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59', 'volume_size': 2, 'snapshot_id': '51eddb06-0710-4b67-b608-53a69b8a2368'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1104084-07c9-4b5d-b511-c8a7b8e9d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1104084-07c9-4b5d-b511-c8a7b8e9d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745fff25-fd43-4097-b0d5-b1c81ab36781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Volume 057c8028-0a21-4b75-afb1-1cdb91fd9b59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59', 'volume_size': 2, 'snapshot_id': '51eddb06-0710-4b67-b608-53a69b8a2368'}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:11 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.498s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:11 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 1G
Apr 09 10:47:11 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:11 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 1G" returned: 0 in 0.511s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522a5754-1979-4744-8701-9354cc41c60b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:11 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522a5754-1979-4744-8701-9354cc41c60b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65
Apr 09 10:47:11 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:12 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522a5754-1979-4744-8701-9354cc41c60b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:12 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 is being set with open permissions: ugo+rw
Apr 09 10:47:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:12 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65
Apr 09 10:47:12 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:12 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65" returned: 0 in 0.408s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:12 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info
Apr 09 10:47:12 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:13 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info" returned: 0 in 0.402s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:13 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info is being set with open permissions: ugo+rw
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:13 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info
Apr 09 10:47:13 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:13 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.info" returned: 0 in 0.425s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.330s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-51eddb06-0710-4b67-b608-53a69b8a2368-057c8028-0a21-4b75-afb1-1cdb91fd9b59" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-51eddb06-0710-4b67-b608-53a69b8a2368-057c8028-0a21-4b75-afb1-1cdb91fd9b59" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Creating volume 057c8028-0a21-4b75-afb1-1cdb91fd9b59 from snapshot 51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-057c8028-0a21-4b75-afb1-1cdb91fd9b59" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ce9725b4-f0c6-4ec6-a088-d600d5105479 tempest-SnapshotDependencyTests-1112461684 None] Create snapshot completed successfully
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-057c8028-0a21-4b75-afb1-1cdb91fd9b59" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] snapshot: 51eddb06-0710-4b67-b608-53a69b8a2368, volume: 057c8028-0a21-4b75-afb1-1cdb91fd9b59,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6814b59-6112-4fd8-bc66-176ee5308fe7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:13 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368
Apr 09 10:47:13 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:14 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca39882-2e01-4982-b715-51e6ffcbfc1b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:14 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:14 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:14 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:14 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59
Apr 09 10:47:14 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Flow 'volume_create_manager' (1ddc39f4-6b15-458e-8c11-e9aceac7d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce3874b-b9df-4eae-b731-96e0071d8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce3874b-b9df-4eae-b731-96e0071d8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c50c095-3961-4dbe-91a5-2061285e59cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca2a904a5104077b7265aaa135282ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=030f754e-a09e-4b7d-aec4-3c5cfed99e65,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:15Z,use_quota=True,user_id='c6f51fc413b54608800c55180b2f6c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9409fb0-cb56-4384-a243-c7bafefcba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9409fb0-cb56-4384-a243-c7bafefcba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77124b0-5696-4260-9a16-e5fd085b3696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77124b0-5696-4260-9a16-e5fd085b3696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c50c095-3961-4dbe-91a5-2061285e59cf', 'volume_name': 'volume-5c50c095-3961-4dbe-91a5-2061285e59cf', 'volume_size': 1, 'snapshot_id': '030f754e-a09e-4b7d-aec4-3c5cfed99e65'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7e79e5-5fd7-47ab-81bd-1a0132cf580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7e79e5-5fd7-47ab-81bd-1a0132cf580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e25afd-6252-478f-afb3-75ad184363a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:14 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Volume 5c50c095-3961-4dbe-91a5-2061285e59cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c50c095-3961-4dbe-91a5-2061285e59cf', 'volume_size': 1, 'snapshot_id': '030f754e-a09e-4b7d-aec4-3c5cfed99e65'}
Apr 09 10:47:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:16 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59" returned: 0 in 1.963s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:16 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3fdcc4-9061-4d05-bb65-3d96d852db13]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:16 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:16 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:17 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.601s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:47:17 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Converted 1024.00 MB image at 521.38 MB/s
Apr 09 10:47:17 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 is being set with open permissions: ugo+rw
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:17 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59
Apr 09 10:47:17 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:17 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59" returned: 0 in 0.413s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-057c8028-0a21-4b75-afb1-1cdb91fd9b59" released by "_copy_volume_from_snapshot" :: held 4.020s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-51eddb06-0710-4b67-b608-53a69b8a2368-057c8028-0a21-4b75-afb1-1cdb91fd9b59" released by "_create_volume_from_snapshot" :: held 4.038s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.059s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.852s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-quobyte-030f754e-a09e-4b7d-aec4-3c5cfed99e65-5c50c095-3961-4dbe-91a5-2061285e59cf" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-030f754e-a09e-4b7d-aec4-3c5cfed99e65-5c50c095-3961-4dbe-91a5-2061285e59cf" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Creating volume 5c50c095-3961-4dbe-91a5-2061285e59cf from snapshot 030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-quobyte-5c50c095-3961-4dbe-91a5-2061285e59cf" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745fff25-fd43-4097-b0d5-b1c81ab36781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59', 'volume_size': 2, 'snapshot_id': '51eddb06-0710-4b67-b608-53a69b8a2368'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a336b8-07a7-45bc-9ab7-6edde2a11e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-5c50c095-3961-4dbe-91a5-2061285e59cf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] snapshot: 030f754e-a09e-4b7d-aec4-3c5cfed99e65, volume: 5c50c095-3961-4dbe-91a5-2061285e59cf,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:17 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Volume volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 (057c8028-0a21-4b75-afb1-1cdb91fd9b59): created successfully
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a336b8-07a7-45bc-9ab7-6edde2a11e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (9c9dd77f-039a-439b-b66f-252f7d20fb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa3cb1-84ad-46ed-9179-fec7bcd4b75a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-820eeea1-6dfd-4e78-a0f4-cca516916c4c tempest-VolumesSnapshotTestJSON-1311983491 None] Created volume successfully.
Apr 09 10:47:17 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65
Apr 09 10:47:17 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:18 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65" returned: 0 in 0.467s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522a5754-1979-4744-8701-9354cc41c60b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f52f6c-bc6a-4f0c-9661-c15c063936df]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:18 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:18 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:18 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-057c8028-0a21-4b75-afb1-1cdb91fd9b59-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-057c8028-0a21-4b75-afb1-1cdb91fd9b59-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:18 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf
Apr 09 10:47:18 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-057c8028-0a21-4b75-afb1-1cdb91fd9b59" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-057c8028-0a21-4b75-afb1-1cdb91fd9b59" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba669605-4a45-4260-9182-ddcd035a4fc8]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:18 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59
Apr 09 10:47:18 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:19 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59" returned: 0 in 0.635s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:19 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59
Apr 09 10:47:19 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:19 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-057c8028-0a21-4b75-afb1-1cdb91fd9b59" returned: 0 in 0.614s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-057c8028-0a21-4b75-afb1-1cdb91fd9b59" released by "delete_volume" :: held 1.274s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['ef5de3d9-d933-4d5a-b99c-092b7f939415', '1093361e-700f-49aa-acaa-d074b2185974', '5c0d28a1-ba25-4b7e-a849-36456d26f6d7', 'c55d1425-029c-43fc-9070-0728979a4fb6'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:20 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:20 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:20 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf" returned: 0 in 2.120s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c81473-82fd-4171-9bbd-c55a5e6a2bdc]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:20 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.634s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleted volume successfully.
Apr 09 10:47:20 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:20 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3ad5fcbc-0668-47b0-b78e-e9fa5bb41dc8 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-057c8028-0a21-4b75-afb1-1cdb91fd9b59-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-51eddb06-0710-4b67-b608-53a69b8a2368-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-51eddb06-0710-4b67-b608-53a69b8a2368-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-db7dc1bb-961b-4242-be4e-ab06dfb92f08" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-db7dc1bb-961b-4242-be4e-ab06dfb92f08" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-51eddb06-0710-4b67-b608-53a69b8a2368" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-51eddb06-0710-4b67-b608-53a69b8a2368" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleting offline snapshot 51eddb06-0710-4b67-b608-53a69b8a2368 of volume db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] snapshot_file for this snap is: volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a6ead-1225-4901-819c-ff21aaa23f02]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:21 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368
Apr 09 10:47:21 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:21 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.627s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:47:21 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Converted 1024.00 MB image at 482.74 MB/s
Apr 09 10:47:21 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf is being set with open permissions: ugo+rw
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:21 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf
Apr 09 10:47:21 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:21 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d5112-b87e-46e2-9ce1-9033dffe7709]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:21 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:21 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:21 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf" returned: 0 in 0.418s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-5c50c095-3961-4dbe-91a5-2061285e59cf" released by "_copy_volume_from_snapshot" :: held 4.171s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-030f754e-a09e-4b7d-aec4-3c5cfed99e65-5c50c095-3961-4dbe-91a5-2061285e59cf" released by "_create_volume_from_snapshot" :: held 4.204s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.224s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e25afd-6252-478f-afb3-75ad184363a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c50c095-3961-4dbe-91a5-2061285e59cf', 'volume_size': 1, 'snapshot_id': '030f754e-a09e-4b7d-aec4-3c5cfed99e65'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897e8c37-5cef-4c39-aecb-78795c213c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Volume volume-5c50c095-3961-4dbe-91a5-2061285e59cf (5c50c095-3961-4dbe-91a5-2061285e59cf): created successfully
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897e8c37-5cef-4c39-aecb-78795c213c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Flow 'volume_create_manager' (1ddc39f4-6b15-458e-8c11-e9aceac7d01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:21 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fb778b7e-70b9-472e-81bc-c30d1fc2dff2 tempest-SnapshotDependencyTests-1112461684 None] Created volume successfully.
Apr 09 10:47:21 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:21 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368
Apr 09 10:47:21 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-030f754e-a09e-4b7d-aec4-3c5cfed99e65-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-030f754e-a09e-4b7d-aec4-3c5cfed99e65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-quobyte-522a5754-1979-4744-8701-9354cc41c60b" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-522a5754-1979-4744-8701-9354cc41c60b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-quobyte-030f754e-a09e-4b7d-aec4-3c5cfed99e65" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-030f754e-a09e-4b7d-aec4-3c5cfed99e65" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Deleting offline snapshot 030f754e-a09e-4b7d-aec4-3c5cfed99e65 of volume 522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] snapshot_file for this snap is: volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7742cb8-4d54-47fd-a3ff-3880f7099887]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:22 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65
Apr 09 10:47:22 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:22 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:22 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368
Apr 09 10:47:22 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:22 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65" returned: 0 in 0.465s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522a5754-1979-4744-8701-9354cc41c60b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b543d361-1727-4da7-80d6-ca3b03aaec3e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:22 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:22 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:22 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08.51eddb06-0710-4b67-b608-53a69b8a2368" returned: 0 in 0.410s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-51eddb06-0710-4b67-b608-53a69b8a2368" released by "_delete_snapshot" :: held 1.913s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-db7dc1bb-961b-4242-be4e-ab06dfb92f08" released by "delete_snapshot" :: held 1.924s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['74b3f23a-d707-4d47-9ad0-68908b73e4f4', '146a8dcb-9348-484f-bc4d-ef0890cdf882', '2d6f525c-8fd9-4fa0-8a21-92ec592a7df7', 'b814930d-3e0c-462f-a33a-0347f8f105f5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Delete snapshot completed successfully.
Apr 09 10:47:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-0a3af6f3-63fa-4314-a809-f7631628dbe2 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-51eddb06-0710-4b67-b608-53a69b8a2368-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-db7dc1bb-961b-4242-be4e-ab06dfb92f08-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-db7dc1bb-961b-4242-be4e-ab06dfb92f08-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-db7dc1bb-961b-4242-be4e-ab06dfb92f08" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-db7dc1bb-961b-4242-be4e-ab06dfb92f08" acquired by "delete_volume" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e6c58-c286-4325-b83b-b820ae0bba69]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:23 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:23 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:23 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.512s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:23 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65
Apr 09 10:47:23 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:23 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:23 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08
Apr 09 10:47:23 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:23 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65" returned: 0 in 0.465s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:23 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65
Apr 09 10:47:23 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:24 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-db7dc1bb-961b-4242-be4e-ab06dfb92f08" returned: 0 in 0.423s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-db7dc1bb-961b-4242-be4e-ab06dfb92f08" released by "delete_volume" :: held 0.947s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['27001c49-a78f-4899-93bf-88ea3b04efde', '91f5fe61-c038-4ff5-8724-ceec6e0625dd', '2d5ab92d-bc6b-467d-91d1-cba56ad2b681', 'fad84ae1-44d3-4a32-85aa-38845a06680b'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:24 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:24 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:24 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b.030f754e-a09e-4b7d-aec4-3c5cfed99e65" returned: 0 in 0.435s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-030f754e-a09e-4b7d-aec4-3c5cfed99e65" released by "_delete_snapshot" :: held 1.930s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-522a5754-1979-4744-8701-9354cc41c60b" released by "delete_snapshot" :: held 1.942s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Created reservations ['c8137b9f-871c-4794-913e-06267c79e455', '32fa224c-f3cc-40b5-85c0-6799f0972578', 'da86b687-aee9-4ea4-9a2b-53b603f5ba59', 'a25457e2-ca43-4ff6-b948-ffed44d9378e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Delete snapshot completed successfully.
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d1a04253-0cc3-4607-a775-3c969394860f tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-030f754e-a09e-4b7d-aec4-3c5cfed99e65-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-522a5754-1979-4744-8701-9354cc41c60b-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-522a5754-1979-4744-8701-9354cc41c60b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-quobyte-522a5754-1979-4744-8701-9354cc41c60b" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-522a5754-1979-4744-8701-9354cc41c60b" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3e8570-a1ba-4e25-8956-0beee92b482c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (c2593e1b-0b37-492d-93de-fc2b307d30db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6875b576-d722-434f-a20f-d555e8e2e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:24 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:24 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6875b576-d722-434f-a20f-d555e8e2e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-409569986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ef2779-4550-4208-b54a-c158c0d7a86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:24Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96aaaa5-a5f6-4df9-a85a-ca53e1fc55f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96aaaa5-a5f6-4df9-a85a-ca53e1fc55f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3cc0c4-7c23-46dc-a281-3051c33a749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3cc0c4-7c23-46dc-a281-3051c33a749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ef2779-4550-4208-b54a-c158c0d7a86b', 'volume_name': 'volume-a3ef2779-4550-4208-b54a-c158c0d7a86b', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6072fcd1-b664-4f68-a100-4f40e2972ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6072fcd1-b664-4f68-a100-4f40e2972ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0211b4-a5fd-438d-ab18-87276c61e21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:24 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume a3ef2779-4550-4208-b54a-c158c0d7a86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ef2779-4550-4208-b54a-c158c0d7a86b', 'volume_size': 1}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-409569986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ef2779-4550-4208-b54a-c158c0d7a86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:24Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Creating volume a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:24 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:24 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b 1073741824
Apr 09 10:47:24 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:24 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.476s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleted volume successfully.
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-73964640-f908-4ee3-b6ec-ba50a0cd1107 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-db7dc1bb-961b-4242-be4e-ab06dfb92f08-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:24 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:24 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b
Apr 09 10:47:24 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:25 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b 1073741824" returned: 0 in 0.501s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:25 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:25 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:25 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-522a5754-1979-4744-8701-9354cc41c60b" returned: 0 in 0.431s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-522a5754-1979-4744-8701-9354cc41c60b" released by "delete_volume" :: held 0.943s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Created reservations ['a2ee225a-59ef-4de2-b029-74883e238c6d', '32cc05be-4cdf-4c3d-b779-125cc8e9d390', '16d88811-389f-4fd4-98ee-f12191926404', 'ab2f3bec-c425-46ce-9e79-0cd8fc2c1e40'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:25 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:25 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-5c50c095-3961-4dbe-91a5-2061285e59cf-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-5c50c095-3961-4dbe-91a5-2061285e59cf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:25 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.454s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "cinder-quobyte-5c50c095-3961-4dbe-91a5-2061285e59cf" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0211b4-a5fd-438d-ab18-87276c61e21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ef2779-4550-4208-b54a-c158c0d7a86b', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8175024d-e7ea-49ee-adb5-e783822fb2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:25 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume volume-a3ef2779-4550-4208-b54a-c158c0d7a86b (a3ef2779-4550-4208-b54a-c158c0d7a86b): created successfully
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8175024d-e7ea-49ee-adb5-e783822fb2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (c2593e1b-0b37-492d-93de-fc2b307d30db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-5c50c095-3961-4dbe-91a5-2061285e59cf" acquired by "delete_volume" :: waited 0.033s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e3f4e8de-0171-4f5b-ab39-41899390d871 tempest-VolumesSnapshotTestJSON-1311983491 None] Created volume successfully.
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2cfca4-9e2d-4abe-980a-ac478af50b44]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:25 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf
Apr 09 10:47:25 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:25 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.435s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Deleted volume successfully.
Apr 09 10:47:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-e8ad7270-912e-4605-8a2e-5af0a83e88c2 tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-522a5754-1979-4744-8701-9354cc41c60b-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:26 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:26 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf
Apr 09 10:47:26 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:26 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5c50c095-3961-4dbe-91a5-2061285e59cf" returned: 0 in 0.399s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-quobyte-5c50c095-3961-4dbe-91a5-2061285e59cf" released by "delete_volume" :: held 0.902s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Created reservations ['0239c514-a7c6-4c28-bda3-0c8a7c2dfcf2', '7363d61f-6883-4bf1-846a-4f3b0d8cfd91', 'b74e4896-d0b6-4248-a85b-04708c4e8339', 'ca84fb2d-db49-47e7-b358-7c5565bcba52'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:26 devstack sudo[89862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:26 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Creating offline snapshot 1c643592-dfdc-4646-99d8-9bb811bf31c7 of volume a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9686a5b8-e1e9-4479-a8f6-670ea33f9e72]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:26 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:26 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:27 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.468s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Deleted volume successfully.
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-367f0935-79a6-4d34-8d37-d50db02a9d1a tempest-SnapshotDependencyTests-1112461684 None] Lock "cinder-5c50c095-3961-4dbe-91a5-2061285e59cf-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:27 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:27 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 1G
Apr 09 10:47:27 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:27 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 1G" returned: 0 in 0.536s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ef2779-4550-4208-b54a-c158c0d7a86b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:27 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ef2779-4550-4208-b54a-c158c0d7a86b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7
Apr 09 10:47:27 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:28 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ef2779-4550-4208-b54a-c158c0d7a86b -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:28 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 is being set with open permissions: ugo+rw
Apr 09 10:47:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:28 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7
Apr 09 10:47:28 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:28 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:28 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info
Apr 09 10:47:28 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:29 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info" returned: 0 in 0.486s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:29 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info is being set with open permissions: ugo+rw
Apr 09 10:47:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:29 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info
Apr 09 10:47:29 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:29 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.info" returned: 0 in 0.442s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:29 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7366411f-d966-4fb5-8a88-503a999546b6 tempest-VolumesSnapshotTestJSON-1311983491 None] Create snapshot completed successfully
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (b6d67311-35fc-4b5e-92e7-b09283053590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1efa07a-92cb-46ed-95f7-c58171ebc136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1efa07a-92cb-46ed-95f7-c58171ebc136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1380292885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782aeebf-e79b-43eb-b69a-415edb1e7fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa993ff9f4d94d2ab6310650fdb4ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c643592-dfdc-4646-99d8-9bb811bf31c7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:30Z,use_quota=True,user_id='ac515818ca634a6aaead64506c9351f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fa8f15-498b-4c28-85d2-051c5e1e6418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fa8f15-498b-4c28-85d2-051c5e1e6418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9645a4ac-f79c-4b7f-b067-8b4eb87c775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9645a4ac-f79c-4b7f-b067-8b4eb87c775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '782aeebf-e79b-43eb-b69a-415edb1e7fb3', 'volume_name': 'volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3', 'volume_size': 1, 'snapshot_id': '1c643592-dfdc-4646-99d8-9bb811bf31c7'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a777e655-03f1-44da-80ee-318c1edda7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a777e655-03f1-44da-80ee-318c1edda7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d049c89a-fc3a-4740-852f-324cf62e62ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:30 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume 782aeebf-e79b-43eb-b69a-415edb1e7fb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3', 'volume_size': 1, 'snapshot_id': '1c643592-dfdc-4646-99d8-9bb811bf31c7'}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-1c643592-dfdc-4646-99d8-9bb811bf31c7-782aeebf-e79b-43eb-b69a-415edb1e7fb3" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-1c643592-dfdc-4646-99d8-9bb811bf31c7-782aeebf-e79b-43eb-b69a-415edb1e7fb3" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Creating volume 782aeebf-e79b-43eb-b69a-415edb1e7fb3 from snapshot 1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-782aeebf-e79b-43eb-b69a-415edb1e7fb3" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-782aeebf-e79b-43eb-b69a-415edb1e7fb3" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] snapshot: 1c643592-dfdc-4646-99d8-9bb811bf31c7, volume: 782aeebf-e79b-43eb-b69a-415edb1e7fb3,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db5240-2c2f-4a34-9550-f0f9056673ac]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:30 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7
Apr 09 10:47:30 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:30 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7" returned: 0 in 0.503s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ef2779-4550-4208-b54a-c158c0d7a86b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fba5ed-650d-476f-baab-bdaa16061b82]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:30 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:30 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:31 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:31 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:47:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:31 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3
Apr 09 10:47:31 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:33 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3" returned: 0 in 2.151s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:33 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a1e74-4a1f-4c8b-93a4-fd9852bd2f8a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:33 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:33 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:34 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.624s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:47:34 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Converted 1024.00 MB image at 475.65 MB/s
Apr 09 10:47:34 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 is being set with open permissions: ugo+rw
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:34 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3
Apr 09 10:47:34 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:34 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3" returned: 0 in 0.419s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-782aeebf-e79b-43eb-b69a-415edb1e7fb3" released by "_copy_volume_from_snapshot" :: held 4.305s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-1c643592-dfdc-4646-99d8-9bb811bf31c7-782aeebf-e79b-43eb-b69a-415edb1e7fb3" released by "_create_volume_from_snapshot" :: held 4.321s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.329s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=120,cinder:DELETE=17,cinder:UPDATE=162,cinder:INSERT=37 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=129,cinder:UPDATE=138,cinder:INSERT=37,cinder:DELETE=10 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d049c89a-fc3a-4740-852f-324cf62e62ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3', 'volume_size': 1, 'snapshot_id': '1c643592-dfdc-4646-99d8-9bb811bf31c7'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a5400d-45dc-463b-ad15-dadec1469339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Volume volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 (782aeebf-e79b-43eb-b69a-415edb1e7fb3): created successfully
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a5400d-45dc-463b-ad15-dadec1469339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Flow 'volume_create_manager' (b6d67311-35fc-4b5e-92e7-b09283053590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5ee226c8-9780-46db-bd04-42bc4fd59da4 tempest-VolumesSnapshotTestJSON-1311983491 None] Created volume successfully.
Apr 09 10:47:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-782aeebf-e79b-43eb-b69a-415edb1e7fb3-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-782aeebf-e79b-43eb-b69a-415edb1e7fb3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-782aeebf-e79b-43eb-b69a-415edb1e7fb3" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-782aeebf-e79b-43eb-b69a-415edb1e7fb3" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919937e-46b8-42a3-b3ef-c6b7ee3f054d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:35 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3
Apr 09 10:47:35 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:36 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3" returned: 0 in 0.463s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:36 devstack sudo[89930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3
Apr 09 10:47:36 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:36 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-782aeebf-e79b-43eb-b69a-415edb1e7fb3" returned: 0 in 0.408s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-782aeebf-e79b-43eb-b69a-415edb1e7fb3" released by "delete_volume" :: held 0.894s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['de4cd012-75a2-45f3-ab4f-fdeab874011a', 'f65a2758-cb9c-46a7-b76a-372048c3ac25', '0cacb8e5-b5b9-440c-8b34-440d04f2a07d', '88f14d83-8939-4531-9d0f-bdad409c07e3'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:36 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:36 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-1c643592-dfdc-4646-99d8-9bb811bf31c7-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-1c643592-dfdc-4646-99d8-9bb811bf31c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-a3ef2779-4550-4208-b54a-c158c0d7a86b" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-a3ef2779-4550-4208-b54a-c158c0d7a86b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-1c643592-dfdc-4646-99d8-9bb811bf31c7" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-1c643592-dfdc-4646-99d8-9bb811bf31c7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Deleting offline snapshot 1c643592-dfdc-4646-99d8-9bb811bf31c7 of volume a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] snapshot_file for this snap is: volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[905da846-fd56-4275-a772-ca8cdde628e9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:36 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7
Apr 09 10:47:36 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:37 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.445s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleted volume successfully.
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b9a13cf5-6b38-41e5-858e-bbb62b8d0871 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-782aeebf-e79b-43eb-b69a-415edb1e7fb3-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:37 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7" returned: 0 in 0.470s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ef2779-4550-4208-b54a-c158c0d7a86b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce24d71-b92b-45c5-865d-0aaf5b2e3c31]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:37 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:37 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:37 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:37 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7
Apr 09 10:47:37 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:38 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7" returned: 0 in 0.458s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:38 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7
Apr 09 10:47:38 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:38 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b.1c643592-dfdc-4646-99d8-9bb811bf31c7" returned: 0 in 0.414s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-1c643592-dfdc-4646-99d8-9bb811bf31c7" released by "_delete_snapshot" :: held 1.870s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-a3ef2779-4550-4208-b54a-c158c0d7a86b" released by "delete_snapshot" :: held 1.880s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['742a0ba9-4e65-418f-a1fa-855245fceec9', '565fcc8c-81a3-4bb7-97f7-7a440b810319', '11e8f78b-0648-474f-af8e-a589e54960f3', 'e7b7792f-6b96-4063-b8bd-8a6069e0a16e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Delete snapshot completed successfully.
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-7978b277-9662-446d-9c84-e4892ea7e51f tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-1c643592-dfdc-4646-99d8-9bb811bf31c7-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-a3ef2779-4550-4208-b54a-c158c0d7a86b-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-a3ef2779-4550-4208-b54a-c158c0d7a86b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-a3ef2779-4550-4208-b54a-c158c0d7a86b" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-a3ef2779-4550-4208-b54a-c158c0d7a86b" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8beeac-5f8f-4f3e-851b-431f9163661d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:39 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:39 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:39 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.467s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:39 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b
Apr 09 10:47:39 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:39 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:39 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:39 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a3ef2779-4550-4208-b54a-c158c0d7a86b" returned: 0 in 0.413s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-a3ef2779-4550-4208-b54a-c158c0d7a86b" released by "delete_volume" :: held 0.908s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['4e80e0f0-9074-469b-bb1d-41fadb61cb9b', 'c3a5fa3f-2463-4bd7-862b-847d7c22d076', 'c2b56afc-2732-4991-8a83-f4682cf87d07', '2f336966-c233-46a3-956b-27db9b44f7d3'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:39 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.424s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:39 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:39 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-14287332-02c6-4645-9c4e-08ab30c3ca0a-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-14287332-02c6-4645-9c4e-08ab30c3ca0a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "cinder-quobyte-14287332-02c6-4645-9c4e-08ab30c3ca0a" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-14287332-02c6-4645-9c4e-08ab30c3ca0a" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980e0bb-e427-465c-898c-b0e987797db5]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:40 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a
Apr 09 10:47:40 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:40 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.440s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleted volume successfully.
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6ef76a7e-2380-414b-b21c-c78b9633f9d7 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-a3ef2779-4550-4208-b54a-c158c0d7a86b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:40 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:40 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a
Apr 09 10:47:40 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:40 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-14287332-02c6-4645-9c4e-08ab30c3ca0a" returned: 0 in 0.400s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-quobyte-14287332-02c6-4645-9c4e-08ab30c3ca0a" released by "delete_volume" :: held 0.903s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Created reservations ['adce42df-8a76-48d6-9811-d6877ea6c77e', '5cbf27f4-6925-4f2f-a037-7fc0656b02de', 'c85e32f1-4b9d-4184-92c7-e9eca25d02b5', '5bf97e82-a508-419c-bd86-aa58df3d1d32'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:41 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:41 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:41 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.408s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Deleted volume successfully.
Apr 09 10:47:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-22e4fd53-eb97-4c4a-b137-5098f2d932a5 tempest-VolumesSnapshotTestJSON-1311983491 None] Lock "cinder-14287332-02c6-4645-9c4e-08ab30c3ca0a-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (f7718dde-b243-4792-82c6-4b26e773598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafe05b8-7949-4910-b28e-0e134c9d9c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafe05b8-7949-4910-b28e-0e134c9d9c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440562872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0927cf2e-4b28-45bf-9b2d-006da1d2f708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:45Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2cd91a-6c2f-4f77-8e64-0b04916b3be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2cd91a-6c2f-4f77-8e64-0b04916b3be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e8f2c6-e21b-4dfe-84ba-3d5f05f56ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e8f2c6-e21b-4dfe-84ba-3d5f05f56ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0927cf2e-4b28-45bf-9b2d-006da1d2f708', 'volume_name': 'volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760606bc-b3de-41fd-8da4-5ff3f9829afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760606bc-b3de-41fd-8da4-5ff3f9829afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5b5b20-4aa6-419e-a194-f3a83ffb69c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:45 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume 0927cf2e-4b28-45bf-9b2d-006da1d2f708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708', 'volume_size': 1}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440562872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0927cf2e-4b28-45bf-9b2d-006da1d2f708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:45Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Creating volume 0927cf2e-4b28-45bf-9b2d-006da1d2f708 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:45 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:45 devstack sudo[89988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 1073741824
Apr 09 10:47:45 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:45 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 1073741824" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:45 devstack sudo[89993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708
Apr 09 10:47:45 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:46 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708" returned: 0 in 0.414s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5b5b20-4aa6-419e-a194-f3a83ffb69c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88ca3e1-a953-45d3-ac22-cb953c60ad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:46 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 (0927cf2e-4b28-45bf-9b2d-006da1d2f708): created successfully
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88ca3e1-a953-45d3-ac22-cb953c60ad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (f7718dde-b243-4792-82c6-4b26e773598a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-fc79570e-e049-4172-9168-ce5ecf37022e tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created volume successfully.
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (8c1f4a3b-1378-4c7c-90a2-d014b4dc3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdb7932-3d9d-4c65-ac99-32bd4b830184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdb7932-3d9d-4c65-ac99-32bd4b830184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091944387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee410403-5482-4c2b-a441-3c56c4ffe8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:47Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680a2204-3012-4e45-aa13-55d2a106f796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680a2204-3012-4e45-aa13-55d2a106f796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6617fbdf-23e8-4c2a-aadb-69a52e2f4ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6617fbdf-23e8-4c2a-aadb-69a52e2f4ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee410403-5482-4c2b-a441-3c56c4ffe8b1', 'volume_name': 'volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462ed1ec-dc59-45a9-a7e4-2e37e0d4ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462ed1ec-dc59-45a9-a7e4-2e37e0d4ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beeabdb7-2cf1-4f72-8e5d-3245eb97e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume ee410403-5482-4c2b-a441-3c56c4ffe8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1', 'volume_size': 1}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091944387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee410403-5482-4c2b-a441-3c56c4ffe8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:47Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Creating volume ee410403-5482-4c2b-a441-3c56c4ffe8b1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:47 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:47 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 1073741824
Apr 09 10:47:47 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (3fde891e-8f7d-4729-8cde-0eb597776586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f281ad7d-6498-45b0-b66b-dd1d6c2842f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f281ad7d-6498-45b0-b66b-dd1d6c2842f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1038352670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4646cc32-40aa-4ce0-aa02-36fa209aa6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9142fc34-59e0-43f2-ba8d-a9683b2f1695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9142fc34-59e0-43f2-ba8d-a9683b2f1695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdb76fc-aa47-46a7-9e6d-b57231c9251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdb76fc-aa47-46a7-9e6d-b57231c9251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4646cc32-40aa-4ce0-aa02-36fa209aa6e2', 'volume_name': 'volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9a085-8eeb-47d6-9300-96ad5122d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9a085-8eeb-47d6-9300-96ad5122d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf06e78-fc6e-470c-b4a1-c5d4e69f41fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume 4646cc32-40aa-4ce0-aa02-36fa209aa6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2', 'volume_size': 1}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (e619423a-94c9-4247-99c7-83631f1a3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0194b13-3c7d-49aa-a80b-d0af6fa5a65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0194b13-3c7d-49aa-a80b-d0af6fa5a65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310513263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90966817-4612-439f-a1f4-8099ab08597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe14cc4-3189-441f-9279-f8a232fbac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe14cc4-3189-441f-9279-f8a232fbac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f536e0-c156-4f5e-9782-f6d1d4c78cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f536e0-c156-4f5e-9782-f6d1d4c78cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90966817-4612-439f-a1f4-8099ab08597e', 'volume_name': 'volume-90966817-4612-439f-a1f4-8099ab08597e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454328fb-514f-4240-8b56-df348090c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454328fb-514f-4240-8b56-df348090c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8f4e7-399d-4ae4-944c-67b1d76e3eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:47 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume 90966817-4612-439f-a1f4-8099ab08597e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90966817-4612-439f-a1f4-8099ab08597e', 'volume_size': 1}
Apr 09 10:47:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (fa327ffc-02a4-4fcb-a423-1a442a83bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc192d33-bbcb-44b4-84b7-834c812f4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc192d33-bbcb-44b4-84b7-834c812f4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644359027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d210f8-0ff6-404b-bb6b-dec0a0d86b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874b873d-58f6-473d-8592-22cce16e50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874b873d-58f6-473d-8592-22cce16e50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f79a072-33c7-437f-bdeb-0e1fc9e4c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f79a072-33c7-437f-bdeb-0e1fc9e4c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d210f8-0ff6-404b-bb6b-dec0a0d86b62', 'volume_name': 'volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1243ddc5-cd33-4a63-9a21-41f9198e97f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1243ddc5-cd33-4a63-9a21-41f9198e97f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4136eceb-6281-4608-bf77-d26389301161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume 05d210f8-0ff6-404b-bb6b-dec0a0d86b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62', 'volume_size': 1}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:48 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 1073741824" returned: 0 in 0.613s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:48 devstack sudo[90001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1
Apr 09 10:47:48 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (102f927a-5d33-492d-b93e-247f53ad9e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc467d4-c2d0-45d0-b28f-33e7f1cdef97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc467d4-c2d0-45d0-b28f-33e7f1cdef97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042444482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff4f513-35ff-403d-a851-43a07243857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff4f513-35ff-403d-a851-43a07243857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d7841f-cc45-447a-b65a-45fd760e8e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d7841f-cc45-447a-b65a-45fd760e8e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c', 'volume_name': 'volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f18b8f-9b2f-4326-acce-d2caa92cabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f18b8f-9b2f-4326-acce-d2caa92cabcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe013184-ecce-4c16-a1d8-ce2626b5c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume 3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c', 'volume_size': 1}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:48 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1038352670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4646cc32-40aa-4ce0-aa02-36fa209aa6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Creating volume 4646cc32-40aa-4ce0-aa02-36fa209aa6e2 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:48 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beeabdb7-2cf1-4f72-8e5d-3245eb97e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 1073741824
Apr 09 10:47:48 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03714931-3b45-44ff-85aa-8035dc689d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:48 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 (ee410403-5482-4c2b-a441-3c56c4ffe8b1): created successfully
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03714931-3b45-44ff-85aa-8035dc689d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:48 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (8c1f4a3b-1378-4c7c-90a2-d014b4dc3060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-17959a04-341c-4762-aa36-6eec2860268f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created volume successfully.
Apr 09 10:47:49 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 1073741824" returned: 0 in 0.499s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:49 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2
Apr 09 10:47:49 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:49 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2" returned: 0 in 0.422s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310513263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90966817-4612-439f-a1f4-8099ab08597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Creating volume 90966817-4612-439f-a1f4-8099ab08597e {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:49 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf06e78-fc6e-470c-b4a1-c5d4e69f41fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:49 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e 1073741824
Apr 09 10:47:49 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459b08a-e0ad-4016-ae7f-6f9a69574293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:49 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 (4646cc32-40aa-4ce0-aa02-36fa209aa6e2): created successfully
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459b08a-e0ad-4016-ae7f-6f9a69574293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:49 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (3fde891e-8f7d-4729-8cde-0eb597776586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:49 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5767530f-2413-4adc-b7e0-b53859427eee tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created volume successfully.
Apr 09 10:47:50 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e 1073741824" returned: 0 in 0.480s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:50 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e
Apr 09 10:47:50 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:50 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e" returned: 0 in 0.455s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.407s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644359027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d210f8-0ff6-404b-bb6b-dec0a0d86b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Creating volume 05d210f8-0ff6-404b-bb6b-dec0a0d86b62 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:50 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8f4e7-399d-4ae4-944c-67b1d76e3eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90966817-4612-439f-a1f4-8099ab08597e', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaea67b2-076a-4169-98bb-010766bea5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:50 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 1073741824
Apr 09 10:47:50 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:50 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume volume-90966817-4612-439f-a1f4-8099ab08597e (90966817-4612-439f-a1f4-8099ab08597e): created successfully
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaea67b2-076a-4169-98bb-010766bea5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (e619423a-94c9-4247-99c7-83631f1a3913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:50 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a15c839d-6f84-44c9-9cf0-640948b74c89 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created volume successfully.
Apr 09 10:47:51 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 1073741824" returned: 0 in 0.484s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:51 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62
Apr 09 10:47:51 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:51 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62" returned: 0 in 0.425s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.178s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042444482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c135da6581456d86b47b4b7e1c2343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:47:48Z,use_quota=True,user_id='a5c8dfd40d9c454d9245c66fbd066b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Creating volume 3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:47:51 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4136eceb-6281-4608-bf77-d26389301161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca5e9c-4768-4d98-927d-a56eeae3197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:51 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c 1073741824
Apr 09 10:47:51 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:51 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 (05d210f8-0ff6-404b-bb6b-dec0a0d86b62): created successfully
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca5e9c-4768-4d98-927d-a56eeae3197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (fa327ffc-02a4-4fcb-a423-1a442a83bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f8285a25-ff76-4837-b756-d0a4a97fec52 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created volume successfully.
Apr 09 10:47:51 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c 1073741824" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:52 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c
Apr 09 10:47:52 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:52 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c" returned: 0 in 0.408s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe013184-ecce-4c16-a1d8-ce2626b5c304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8fe666-0099-4e71-8128-6d69650ca33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:47:52 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Volume volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c (3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c): created successfully
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8fe666-0099-4e71-8128-6d69650ca33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Flow 'volume_create_manager' (102f927a-5d33-492d-b93e-247f53ad9e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:47:52 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-94750045-8781-4143-8a3b-41821e4dc00f tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created volume successfully.
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-quobyte-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[393ed9c9-8e2c-4329-a080-d0e6c6d1a5c1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:52 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c
Apr 09 10:47:52 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:53 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:53 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c
Apr 09 10:47:53 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:53 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c" returned: 0 in 0.410s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c" released by "delete_volume" :: held 0.905s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created reservations ['f11e669a-31ce-4b19-ab5c-d91a93278afd', '26962cae-e1f5-43b5-a7ca-97d40abda228', 'c922f1eb-6907-4adf-9e37-5d26da7df40a', '173b1e1d-3fdf-4913-9c71-6689eae15bdc'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:53 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:53 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-05d210f8-0ff6-404b-bb6b-dec0a0d86b62-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-05d210f8-0ff6-404b-bb6b-dec0a0d86b62-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-quobyte-05d210f8-0ff6-404b-bb6b-dec0a0d86b62" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-05d210f8-0ff6-404b-bb6b-dec0a0d86b62" acquired by "delete_volume" :: waited 0.016s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5a756-e097-43ea-9e74-dd065d188bc6]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:53 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62
Apr 09 10:47:53 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:54 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.418s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Deleted volume successfully.
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ce1ce055-7ce4-4d50-b8b7-9f74c20d74bd tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-3fd6eb1e-db91-4315-9c8e-a3b5f49a4c8c-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:54 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:54 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62
Apr 09 10:47:54 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:54 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-05d210f8-0ff6-404b-bb6b-dec0a0d86b62" returned: 0 in 0.419s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-05d210f8-0ff6-404b-bb6b-dec0a0d86b62" released by "delete_volume" :: held 0.920s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created reservations ['87dc1b33-9dcf-4fe5-9748-a18860c5cf56', '846faeb0-1411-4f39-9d00-98f8beafd640', 'f43adab5-92be-44b8-9200-4bf1f978eadb', '012c6e6c-acd4-4a86-9b8d-31f3a7eabf32'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:54 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:54 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-90966817-4612-439f-a1f4-8099ab08597e-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-90966817-4612-439f-a1f4-8099ab08597e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-quobyte-90966817-4612-439f-a1f4-8099ab08597e" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-90966817-4612-439f-a1f4-8099ab08597e" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e39ba-7e0a-4a3d-8019-71ef9cb2797d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:55 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e
Apr 09 10:47:55 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:55 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Deleted volume successfully.
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-38bac379-62d3-455a-ad3d-bd552da63b83 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-05d210f8-0ff6-404b-bb6b-dec0a0d86b62-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:55 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e" returned: 0 in 0.481s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:55 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e
Apr 09 10:47:55 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:55 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-90966817-4612-439f-a1f4-8099ab08597e" returned: 0 in 0.404s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-90966817-4612-439f-a1f4-8099ab08597e" released by "delete_volume" :: held 0.906s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created reservations ['ad529205-658a-45bf-9649-f0c185bcdca9', '6b356479-e7d3-4b47-bf8d-b1a04be998c0', 'bbd76a76-be98-416c-a000-2f02b9a7f1c6', '7152d641-40ac-4796-8088-ee161354e291'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:55 devstack sudo[90102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:55 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-4646cc32-40aa-4ce0-aa02-36fa209aa6e2-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-4646cc32-40aa-4ce0-aa02-36fa209aa6e2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-quobyte-4646cc32-40aa-4ce0-aa02-36fa209aa6e2" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-4646cc32-40aa-4ce0-aa02-36fa209aa6e2" acquired by "delete_volume" :: waited 0.006s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f3b481-3a2a-4e66-b900-f0f93a37b3af]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:56 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2
Apr 09 10:47:56 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:56 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.423s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:56 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Deleted volume successfully.
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-078935e7-31b6-42d3-8d12-a1374114ef99 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-90966817-4612-439f-a1f4-8099ab08597e-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:56 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:56 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2
Apr 09 10:47:56 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:56 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-4646cc32-40aa-4ce0-aa02-36fa209aa6e2" returned: 0 in 0.420s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-4646cc32-40aa-4ce0-aa02-36fa209aa6e2" released by "delete_volume" :: held 0.929s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created reservations ['b8b7dcea-0cd4-46ba-97f1-dc0f39d71eb5', '1b854195-3b53-4aa2-812e-6633df4893db', '019fe15d-88cb-4204-9b3c-cc4a6cb5d397', '4ffeb37a-b9e1-4f4d-9cc2-92adb2526bd9'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:57 devstack sudo[90113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:57 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-ee410403-5482-4c2b-a441-3c56c4ffe8b1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-ee410403-5482-4c2b-a441-3c56c4ffe8b1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-quobyte-ee410403-5482-4c2b-a441-3c56c4ffe8b1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-ee410403-5482-4c2b-a441-3c56c4ffe8b1" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e0624a-64ae-4cbc-aea5-fda4de46aa64]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:57 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1
Apr 09 10:47:57 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:57 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.421s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Deleted volume successfully.
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-36eb64d3-9e9e-43e1-b17f-f638487be7af tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-4646cc32-40aa-4ce0-aa02-36fa209aa6e2-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:57 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:57 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1
Apr 09 10:47:57 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:58 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-ee410403-5482-4c2b-a441-3c56c4ffe8b1" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-ee410403-5482-4c2b-a441-3c56c4ffe8b1" released by "delete_volume" :: held 0.932s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created reservations ['8abe7e71-4429-49af-a6bf-2fb2d3fdb4ec', '96e058e8-0de4-4fc3-93a8-5239b53d70de', '2488b347-172b-4f87-8199-2450ef2004b7', '6b72a258-89b5-4c9e-b331-de41e07ef9a5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:58 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:58 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-0927cf2e-4b28-45bf-9b2d-006da1d2f708-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-0927cf2e-4b28-45bf-9b2d-006da1d2f708-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "cinder-quobyte-0927cf2e-4b28-45bf-9b2d-006da1d2f708" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-0927cf2e-4b28-45bf-9b2d-006da1d2f708" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561692d-1e65-41e7-93d4-ce23199e930e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:58 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708
Apr 09 10:47:58 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:58 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.440s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Deleted volume successfully.
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef7e382d-91c9-4ec3-948b-1ee409edbce9 tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-ee410403-5482-4c2b-a441-3c56c4ffe8b1-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:58 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708" returned: 0 in 0.510s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:58 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708
Apr 09 10:47:58 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:59 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-0927cf2e-4b28-45bf-9b2d-006da1d2f708" returned: 0 in 0.408s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-quobyte-0927cf2e-4b28-45bf-9b2d-006da1d2f708" released by "delete_volume" :: held 0.950s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Created reservations ['9208c901-a2c2-44ba-af7f-af45e8ab05c1', 'b72a1cd5-b620-49ed-b7a2-96c5a043aae6', 'f8d61451-060b-445f-b3a7-9d17d4199d3c', 'ae52050c-3dc5-464f-b5cd-a9a8a3b2e976'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:47:59 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:47:59 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:47:59 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:47:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Deleted volume successfully.
Apr 09 10:47:59 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-da75eb95-4058-4042-a123-33ada0f617ea tempest-CreateVolumesFromSourceVolumeTest-1181592522 None] Lock "cinder-0927cf2e-4b28-45bf-9b2d-006da1d2f708-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (872bcce8-919b-44fb-b9c8-a6d77b604352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d04aedf-95a2-4063-930e-a15c0815e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d04aedf-95a2-4063-930e-a15c0815e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-677255207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84707647-8d9c-4dd6-9e39-1b8c2e639191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d525dea584494ca9f7991174b66236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:06Z,use_quota=True,user_id='3e5e746c62e844b58fb51df7b84a26ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e531dd52-70c9-43ca-bf88-82ff029730f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e531dd52-70c9-43ca-bf88-82ff029730f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30554d2-b573-42b5-9690-8b82a7117d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30554d2-b573-42b5-9690-8b82a7117d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84707647-8d9c-4dd6-9e39-1b8c2e639191', 'volume_name': 'volume-84707647-8d9c-4dd6-9e39-1b8c2e639191', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f68de-9fa5-42d3-9a45-38072be6cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f68de-9fa5-42d3-9a45-38072be6cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe00f81f-0f19-40ff-bfc9-314f205578ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Volume 84707647-8d9c-4dd6-9e39-1b8c2e639191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84707647-8d9c-4dd6-9e39-1b8c2e639191', 'volume_size': 1}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-677255207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84707647-8d9c-4dd6-9e39-1b8c2e639191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d525dea584494ca9f7991174b66236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:06Z,use_quota=True,user_id='3e5e746c62e844b58fb51df7b84a26ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Creating volume 84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:06 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:06 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 1073741824
Apr 09 10:48:06 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (c96e5bc9-3086-4249-b911-60f322c46168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe68e58-0f39-4052-a2d5-466d6b6bfb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe68e58-0f39-4052-a2d5-466d6b6bfb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1517461600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de216ec-bc20-4c16-9f19-714d3230b93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:06Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29645bb7-e514-41d2-8fc9-6e87135d2e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29645bb7-e514-41d2-8fc9-6e87135d2e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c3a91f-f8da-4dfd-b561-9432996732fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c3a91f-f8da-4dfd-b561-9432996732fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de216ec-bc20-4c16-9f19-714d3230b93a', 'volume_name': 'volume-6de216ec-bc20-4c16-9f19-714d3230b93a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ff0280-a94b-4864-a301-0daea2e95204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ff0280-a94b-4864-a301-0daea2e95204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdaf3b4-ddac-4cf7-bf65-fb8ace9cb50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume 6de216ec-bc20-4c16-9f19-714d3230b93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de216ec-bc20-4c16-9f19-714d3230b93a', 'volume_size': 1}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (2697cd5d-5520-4382-9c4d-eaff866451df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51f23f7-1c53-4384-b15e-f0651574d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51f23f7-1c53-4384-b15e-f0651574d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-288263856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91e1204-c73f-443b-ab56-fc805c844c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a79f2b-d5fa-4865-81a9-9ebaeee22bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a79f2b-d5fa-4865-81a9-9ebaeee22bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7cd598-5b3a-42bf-8409-4bab90acd8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7cd598-5b3a-42bf-8409-4bab90acd8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91e1204-c73f-443b-ab56-fc805c844c7d', 'volume_name': 'volume-c91e1204-c73f-443b-ab56-fc805c844c7d', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8819cc55-de3a-4212-8b3f-9109cbba9139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8819cc55-de3a-4212-8b3f-9109cbba9139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f8b831-a41d-4b5b-a2ec-2276608a1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Volume c91e1204-c73f-443b-ab56-fc805c844c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91e1204-c73f-443b-ab56-fc805c844c7d', 'volume_size': 1}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (44acfde8-5fc0-4c9a-aebf-80ab27f6ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2667e0c2-daf8-4f76-b447-670803dbc370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2667e0c2-daf8-4f76-b447-670803dbc370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1607387377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30040056-1216-4ae3-b491-6e81617b43f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da596dc-7ed4-449c-9ed9-c8e061abf60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da596dc-7ed4-449c-9ed9-c8e061abf60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19324339-8eb8-4bed-b6eb-b13656a859e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19324339-8eb8-4bed-b6eb-b13656a859e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30040056-1216-4ae3-b491-6e81617b43f6', 'volume_name': 'volume-30040056-1216-4ae3-b491-6e81617b43f6', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae00b3b5-1db0-4d1f-b14d-f19858e8ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae00b3b5-1db0-4d1f-b14d-f19858e8ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a384e4aa-2c1b-4095-8aa1-5460e6c737f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:06 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Volume 30040056-1216-4ae3-b491-6e81617b43f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30040056-1216-4ae3-b491-6e81617b43f6', 'volume_size': 1}
Apr 09 10:48:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:07 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 1073741824" returned: 0 in 0.610s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (7cfc20be-4921-42f8-83da-3cb92c3b79c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306ff530-ec06-453f-85ea-2ad32d437bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306ff530-ec06-453f-85ea-2ad32d437bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-513636454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017d7e25-b864-4a80-b8c2-40249a57ae80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe21551-ca00-4b68-822a-0203637ca8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe21551-ca00-4b68-822a-0203637ca8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d7e568-3d00-4376-8dfe-37fc5523db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d7e568-3d00-4376-8dfe-37fc5523db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017d7e25-b864-4a80-b8c2-40249a57ae80', 'volume_name': 'volume-017d7e25-b864-4a80-b8c2-40249a57ae80', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d56200f-7a72-40d8-b4b9-451ee9c812a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d56200f-7a72-40d8-b4b9-451ee9c812a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b9d869-c199-48b8-86da-2fe6dab0d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Volume 017d7e25-b864-4a80-b8c2-40249a57ae80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017d7e25-b864-4a80-b8c2-40249a57ae80', 'volume_size': 1}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (2a51ac95-bd4e-4288-ad01-6149cf2d1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05533cfc-b08c-4044-a703-d2c506702050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05533cfc-b08c-4044-a703-d2c506702050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1615063985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bf322f-4c52-4bfc-9dca-76f38d75984f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea98c4e-594b-4fec-b6a4-5f3fa1f225a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea98c4e-594b-4fec-b6a4-5f3fa1f225a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20852f50-a415-4e80-9d27-f6b0a7f3a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20852f50-a415-4e80-9d27-f6b0a7f3a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bf322f-4c52-4bfc-9dca-76f38d75984f', 'volume_name': 'volume-62bf322f-4c52-4bfc-9dca-76f38d75984f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574829ea-2bc3-4566-8b29-d2501ff97343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574829ea-2bc3-4566-8b29-d2501ff97343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228445cc-e40b-4d0d-8789-2c0c6ed17b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Volume 62bf322f-4c52-4bfc-9dca-76f38d75984f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bf322f-4c52-4bfc-9dca-76f38d75984f', 'volume_size': 1}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (05995387-f5b8-498b-ae66-ff35f26dd410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f88204-5642-455f-9def-303301fd1f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f88204-5642-455f-9def-303301fd1f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009288885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86db083-5b83-4adc-aa9c-562233f61c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f282da-60f0-4768-9747-77a9e940af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f282da-60f0-4768-9747-77a9e940af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd425c0-c15a-4bf6-9acb-5e8267c777ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd425c0-c15a-4bf6-9acb-5e8267c777ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86db083-5b83-4adc-aa9c-562233f61c03', 'volume_name': 'volume-c86db083-5b83-4adc-aa9c-562233f61c03', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20d8220-753b-4743-abe8-40b61db911ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20d8220-753b-4743-abe8-40b61db911ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf7ed16-2207-4b98-ae2c-efd47aa7d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Volume c86db083-5b83-4adc-aa9c-562233f61c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86db083-5b83-4adc-aa9c-562233f61c03', 'volume_size': 1}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:07 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1517461600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de216ec-bc20-4c16-9f19-714d3230b93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:06Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating volume 6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:07 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe00f81f-0f19-40ff-bfc9-314f205578ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84707647-8d9c-4dd6-9e39-1b8c2e639191', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a 1073741824
Apr 09 10:48:07 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d5109-7cb0-4133-937c-d3ad2328d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:07 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Volume volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 (84707647-8d9c-4dd6-9e39-1b8c2e639191): created successfully
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d5109-7cb0-4133-937c-d3ad2328d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:07 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (872bcce8-919b-44fb-b9c8-a6d77b604352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:07 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f82210cc-bd50-4c2a-b57a-f98790e83233 tempest-VolumeDependencyTests-997215210 None] Created volume successfully.
Apr 09 10:48:08 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a 1073741824" returned: 0 in 0.534s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:08 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a
Apr 09 10:48:08 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:08 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a" returned: 0 in 0.529s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-288263856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91e1204-c73f-443b-ab56-fc805c844c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Creating volume c91e1204-c73f-443b-ab56-fc805c844c7d {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:08 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdaf3b4-ddac-4cf7-bf65-fb8ace9cb50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de216ec-bc20-4c16-9f19-714d3230b93a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783486f-74b5-4a58-8f91-26057c4edf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:08 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d 1073741824
Apr 09 10:48:08 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:08 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume volume-6de216ec-bc20-4c16-9f19-714d3230b93a (6de216ec-bc20-4c16-9f19-714d3230b93a): created successfully
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783486f-74b5-4a58-8f91-26057c4edf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:08 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (c96e5bc9-3086-4249-b911-60f322c46168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8f30078d-0248-4ed1-b33b-f9cc487a75b8 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created volume successfully.
Apr 09 10:48:09 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d 1073741824" returned: 0 in 0.502s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:09 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d
Apr 09 10:48:09 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:09 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1607387377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30040056-1216-4ae3-b491-6e81617b43f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Creating volume 30040056-1216-4ae3-b491-6e81617b43f6 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:09 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f8b831-a41d-4b5b-a2ec-2276608a1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91e1204-c73f-443b-ab56-fc805c844c7d', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e788e406-ec74-4398-b0d0-5b08c9128a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:09 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6 1073741824
Apr 09 10:48:09 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:09 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Volume volume-c91e1204-c73f-443b-ab56-fc805c844c7d (c91e1204-c73f-443b-ab56-fc805c844c7d): created successfully
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e788e406-ec74-4398-b0d0-5b08c9128a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:09 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (2697cd5d-5520-4382-9c4d-eaff866451df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:09 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4992bc06-83de-43d5-8de1-a9da2d581478 tempest-CreateVolumesFromImageTest-391736615 None] Created volume successfully.
Apr 09 10:48:10 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6 1073741824" returned: 0 in 0.556s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:10 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6
Apr 09 10:48:10 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:10 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6" returned: 0 in 0.479s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.647s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-513636454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017d7e25-b864-4a80-b8c2-40249a57ae80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Creating volume 017d7e25-b864-4a80-b8c2-40249a57ae80 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:10 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a384e4aa-2c1b-4095-8aa1-5460e6c737f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30040056-1216-4ae3-b491-6e81617b43f6', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750f2b2d-2016-4364-80fc-c71119658a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:10 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80 1073741824
Apr 09 10:48:10 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:10 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Volume volume-30040056-1216-4ae3-b491-6e81617b43f6 (30040056-1216-4ae3-b491-6e81617b43f6): created successfully
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750f2b2d-2016-4364-80fc-c71119658a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:10 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (44acfde8-5fc0-4c9a-aebf-80ab27f6ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:10 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f4dd3850-ff95-419a-9cfe-36b863314f08 tempest-CreateVolumesFromImageTest-391736615 None] Created volume successfully.
Apr 09 10:48:11 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80 1073741824" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:11 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80
Apr 09 10:48:11 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:11 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.425s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1615063985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bf322f-4c52-4bfc-9dca-76f38d75984f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Creating volume 62bf322f-4c52-4bfc-9dca-76f38d75984f {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:11 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b9d869-c199-48b8-86da-2fe6dab0d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017d7e25-b864-4a80-b8c2-40249a57ae80', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129bbae-6b99-4da9-85e3-05d57b2f66cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:11 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f 1073741824
Apr 09 10:48:11 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:11 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Volume volume-017d7e25-b864-4a80-b8c2-40249a57ae80 (017d7e25-b864-4a80-b8c2-40249a57ae80): created successfully
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129bbae-6b99-4da9-85e3-05d57b2f66cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:11 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (7cfc20be-4921-42f8-83da-3cb92c3b79c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:11 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-28fd9b02-87a7-41d9-88b9-948f49a4ac77 tempest-CreateVolumesFromImageTest-391736615 None] Created volume successfully.
Apr 09 10:48:12 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f 1073741824" returned: 0 in 0.585s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:12 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f
Apr 09 10:48:12 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:12 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f" returned: 0 in 0.506s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.428s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009288885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86db083-5b83-4adc-aa9c-562233f61c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6fd1fd0574d2289b04f0743a4a192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:07Z,use_quota=True,user_id='7dccc56cceed43bbb67298b6ec2ec6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Creating volume c86db083-5b83-4adc-aa9c-562233f61c03 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:12 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:12 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228445cc-e40b-4d0d-8789-2c0c6ed17b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bf322f-4c52-4bfc-9dca-76f38d75984f', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9112a7e-694f-4101-a64b-1c933b974cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:13 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03 1073741824
Apr 09 10:48:13 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:13 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Volume volume-62bf322f-4c52-4bfc-9dca-76f38d75984f (62bf322f-4c52-4bfc-9dca-76f38d75984f): created successfully
Apr 09 10:48:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9112a7e-694f-4101-a64b-1c933b974cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:13 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (2a51ac95-bd4e-4288-ad01-6149cf2d1690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:13 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ccd8be83-900b-44a9-80d0-59a6efe88fd9 tempest-CreateVolumesFromImageTest-391736615 None] Created volume successfully.
Apr 09 10:48:13 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03 1073741824" returned: 0 in 0.536s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:13 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:13 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03
Apr 09 10:48:13 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:14 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03" returned: 0 in 0.492s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.402s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf7ed16-2207-4b98-ae2c-efd47aa7d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86db083-5b83-4adc-aa9c-562233f61c03', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9acb00-1a1a-4472-bbf0-25d52abc3d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:14 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Volume volume-c86db083-5b83-4adc-aa9c-562233f61c03 (c86db083-5b83-4adc-aa9c-562233f61c03): created successfully
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9acb00-1a1a-4472-bbf0-25d52abc3d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Flow 'volume_create_manager' (05995387-f5b8-498b-ae66-ff35f26dd410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Creating offline snapshot f9ed6294-27fe-46ee-b0cc-78ac44a27b0d of volume 84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:48:14 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-04b85d34-19ac-48ac-a9bc-27614b96c1b5 tempest-CreateVolumesFromImageTest-391736615 None] Created volume successfully.
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0c525-9cf0-4d98-b36b-69788cd02144]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:14 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:14 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:14 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.518s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:14 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:14 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d 1G
Apr 09 10:48:14 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-c86db083-5b83-4adc-aa9c-562233f61c03-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-c86db083-5b83-4adc-aa9c-562233f61c03-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:15 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d 1G" returned: 0 in 0.546s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:15 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d
Apr 09 10:48:15 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-quobyte-c86db083-5b83-4adc-aa9c-562233f61c03" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-c86db083-5b83-4adc-aa9c-562233f61c03" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a7c38f-e4f1-4377-a9ca-6c0ab510e061]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:15 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03
Apr 09 10:48:15 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:15 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:15 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d is being set with open permissions: ugo+rw
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:15 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d
Apr 09 10:48:15 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:15 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03" returned: 0 in 0.555s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:15 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:15 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03
Apr 09 10:48:15 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:16 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" returned: 0 in 0.449s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:16 devstack sudo[90263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info
Apr 09 10:48:16 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:16 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c86db083-5b83-4adc-aa9c-562233f61c03" returned: 0 in 0.437s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-c86db083-5b83-4adc-aa9c-562233f61c03" released by "delete_volume" :: held 1.015s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Created reservations ['a25a120d-274a-49d0-851f-9660cb43220a', '267c9ba4-50d8-4817-bc92-140920eff665', '5cf7d731-6e48-4503-a92d-16c1983bb8de', '2da24c10-57d9-417f-ab09-9cfd45ed4a23'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:16 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:16 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:16 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info" returned: 0 in 0.481s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:16 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info is being set with open permissions: ugo+rw
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:16 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info
Apr 09 10:48:16 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:16 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.554s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:16 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Deleted volume successfully.
Apr 09 10:48:16 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4640fd87-66e6-41c5-8941-77f57d5bb804 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-c86db083-5b83-4adc-aa9c-562233f61c03-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:17 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.info" returned: 0 in 0.413s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.329s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating offline snapshot 9d528b01-697c-439d-857d-2df928d8c57f of volume 6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:48:17 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-37e71502-9284-41f4-a463-a959b8214490 tempest-VolumeDependencyTests-997215210 None] Create snapshot completed successfully
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a76a15-a4d3-42f1-9b5c-2d498943b779]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:17 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a
Apr 09 10:48:17 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-62bf322f-4c52-4bfc-9dca-76f38d75984f-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-62bf322f-4c52-4bfc-9dca-76f38d75984f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-quobyte-62bf322f-4c52-4bfc-9dca-76f38d75984f" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-62bf322f-4c52-4bfc-9dca-76f38d75984f" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6cc40-0f88-41d4-a7c6-ac854dc8d672]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:17 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f
Apr 09 10:48:17 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:17 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a" returned: 0 in 0.577s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:17 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:17 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f 1G
Apr 09 10:48:17 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:18 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f" returned: 0 in 0.674s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:18 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f
Apr 09 10:48:18 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:18 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f 1G" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de216ec-bc20-4c16-9f19-714d3230b93a -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:18 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de216ec-bc20-4c16-9f19-714d3230b93a -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f
Apr 09 10:48:18 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (9ed7e3a5-546a-4cd2-9e42-d296bca58067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5246de2c-8bdf-4a00-9199-51fe2ffa025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5246de2c-8bdf-4a00-9199-51fe2ffa025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1212316402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293a4bab-305c-45c8-9152-d56de70f99e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d525dea584494ca9f7991174b66236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9ed6294-27fe-46ee-b0cc-78ac44a27b0d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:18Z,use_quota=True,user_id='3e5e746c62e844b58fb51df7b84a26ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d94561e-8d32-46ca-a499-39a5b5a875ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d94561e-8d32-46ca-a499-39a5b5a875ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3c32c5-36cf-4797-b9fe-80a7982f7d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3c32c5-36cf-4797-b9fe-80a7982f7d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '293a4bab-305c-45c8-9152-d56de70f99e1', 'volume_name': 'volume-293a4bab-305c-45c8-9152-d56de70f99e1', 'volume_size': 1, 'snapshot_id': 'f9ed6294-27fe-46ee-b0cc-78ac44a27b0d'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df4bebe-cb6c-4279-a143-2c4ed490f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df4bebe-cb6c-4279-a143-2c4ed490f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acdf6dc-991f-427c-a745-db43d995a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:18 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Volume 293a4bab-305c-45c8-9152-d56de70f99e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-293a4bab-305c-45c8-9152-d56de70f99e1', 'volume_size': 1, 'snapshot_id': 'f9ed6294-27fe-46ee-b0cc-78ac44a27b0d'}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:18 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-62bf322f-4c52-4bfc-9dca-76f38d75984f" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-62bf322f-4c52-4bfc-9dca-76f38d75984f" released by "delete_volume" :: held 1.244s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Created reservations ['c53a5540-9c09-4242-b30d-e12237ab20e4', 'b4ecfdff-300b-48f2-a724-2d02f88f7185', '25950907-1075-46d8-a0ec-e18f2cdf4300', '0ed6d593-1b27-4a09-a47d-dd0d9589727e'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:18 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de216ec-bc20-4c16-9f19-714d3230b93a -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f" returned: 0 in 0.578s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:18 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f is being set with open permissions: ugo+rw
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:18 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:18 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f
Apr 09 10:48:18 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:18 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:18 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:19 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.442s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:19 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Deleted volume successfully.
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a47fcf27-cd86-4f54-afa5-c9fdabfb384f tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-62bf322f-4c52-4bfc-9dca-76f38d75984f-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Flow 'volume_create_manager' (873840c0-59dd-4dc1-8a4a-4a9f060a4fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99284ef-67da-40b9-bda6-219b4368e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99284ef-67da-40b9-bda6-219b4368e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1494981856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbb4180-0271-43ca-a8cd-af1c936014d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7ba43f056249768c3661609c51538f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:19Z,use_quota=True,user_id='1f2dd549e07a49cd951674d506e572c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:19 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b53c3ab-99bb-46ac-aa32-dc8890558a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b53c3ab-99bb-46ac-aa32-dc8890558a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30b25ea-70fb-47f3-a43e-14fd7afd9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30b25ea-70fb-47f3-a43e-14fd7afd9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbb4180-0271-43ca-a8cd-af1c936014d1', 'volume_name': 'volume-3bbb4180-0271-43ca-a8cd-af1c936014d1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1003d403-fe35-42ae-a46f-cc3f4fed334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1003d403-fe35-42ae-a46f-cc3f4fed334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cac2cb-aeb4-4758-ab40-21241e41cbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:19 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Volume 3bbb4180-0271-43ca-a8cd-af1c936014d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbb4180-0271-43ca-a8cd-af1c936014d1', 'volume_size': 1}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f" returned: 0 in 0.683s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:19 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info
Apr 09 10:48:19 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-017d7e25-b864-4a80-b8c2-40249a57ae80-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-017d7e25-b864-4a80-b8c2-40249a57ae80-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-quobyte-017d7e25-b864-4a80-b8c2-40249a57ae80" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-017d7e25-b864-4a80-b8c2-40249a57ae80" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aacc0b-4b5c-486c-a6db-58500c0e9a50]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:19 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80
Apr 09 10:48:19 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:19 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:19 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info is being set with open permissions: ugo+rw
Apr 09 10:48:19 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:19 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info
Apr 09 10:48:19 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:20 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80" returned: 0 in 0.498s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:20 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80
Apr 09 10:48:20 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:20 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.info" returned: 0 in 0.407s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.314s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.965s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d-293a4bab-305c-45c8-9152-d56de70f99e1" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:20 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3ab0bebe-8a9f-42bc-a274-143c3c300e31 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Create snapshot completed successfully
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d-293a4bab-305c-45c8-9152-d56de70f99e1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Creating volume 293a4bab-305c-45c8-9152-d56de70f99e1 from snapshot f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-293a4bab-305c-45c8-9152-d56de70f99e1" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-293a4bab-305c-45c8-9152-d56de70f99e1" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] snapshot: f9ed6294-27fe-46ee-b0cc-78ac44a27b0d, volume: 293a4bab-305c-45c8-9152-d56de70f99e1,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3fb36-c117-4ba1-9ddd-5383ad16c2a2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:20 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d
Apr 09 10:48:20 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:20 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-017d7e25-b864-4a80-b8c2-40249a57ae80" returned: 0 in 0.421s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-017d7e25-b864-4a80-b8c2-40249a57ae80" released by "delete_volume" :: held 0.948s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Created reservations ['99f4d9a1-02ca-42b6-b8e3-9164d693ad1b', '55ab04f6-e9ea-4fbd-a51a-0b0e72e6733c', '028c20bf-1e30-4508-b2e4-4a881dfbabe5', 'b24edba8-e397-4fe7-9f3c-849eefa23139'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:20 devstack sudo[90318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:20 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-30040056-1216-4ae3-b491-6e81617b43f6-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-30040056-1216-4ae3-b491-6e81617b43f6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-quobyte-30040056-1216-4ae3-b491-6e81617b43f6" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-30040056-1216-4ae3-b491-6e81617b43f6" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e605d336-67a2-428e-a46e-a9efaee11015]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:20 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6
Apr 09 10:48:20 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:20 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" returned: 0 in 0.497s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84707647-8d9c-4dd6-9e39-1b8c2e639191(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[49665d7c-316c-470f-a45d-ca4e0c52a88c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:20 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:20 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:20 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:21 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:21 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Deleted volume successfully.
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2c30f804-feeb-4147-b7dc-e1294dc36b2b tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-017d7e25-b864-4a80-b8c2-40249a57ae80-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:21 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6" returned: 0 in 0.496s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:21 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6
Apr 09 10:48:21 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (a0717d9c-fe68-4734-8f96-7463f9ce3f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5e1599-8890-43c5-a6d2-93cc02d8967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5e1599-8890-43c5-a6d2-93cc02d8967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060663947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d84b13-07fa-4520-97d3-b399e8a12a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:21Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95dbb6ce-c682-4ef8-882f-475e75f51a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95dbb6ce-c682-4ef8-882f-475e75f51a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63bbb8c-fa76-4344-8bfa-36e67230a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63bbb8c-fa76-4344-8bfa-36e67230a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d84b13-07fa-4520-97d3-b399e8a12a64', 'volume_name': 'volume-f5d84b13-07fa-4520-97d3-b399e8a12a64', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7da386f-d825-49bd-a5d0-c1b802b7222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7da386f-d825-49bd-a5d0-c1b802b7222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87f9a70-301e-449d-8b26-66ee059ee80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume f5d84b13-07fa-4520-97d3-b399e8a12a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d84b13-07fa-4520-97d3-b399e8a12a64', 'volume_size': 1}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:21 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (0afecf40-731a-4fd4-bd00-17ce4358c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee376a51-78cb-4dc4-aeb9-0477461eb814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.696s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee376a51-78cb-4dc4-aeb9-0477461eb814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732586630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cf2429-e0e7-49e7-9e82-f644b74a0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cf2429-e0e7-49e7-9e82-f644b74a0193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564d443a-2908-4b55-b0d1-ba10861ac904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564d443a-2908-4b55-b0d1-ba10861ac904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388', 'volume_name': 'volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656ed151-df0d-43e8-99f6-e3bf4f801ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656ed151-df0d-43e8-99f6-e3bf4f801ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30df426-1388-4dee-8b84-c13fe683f8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume 47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388', 'volume_size': 1}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:21 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1
Apr 09 10:48:21 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:21 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-30040056-1216-4ae3-b491-6e81617b43f6" returned: 0 in 0.462s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-30040056-1216-4ae3-b491-6e81617b43f6" released by "delete_volume" :: held 0.980s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (5e96b658-e417-469f-9052-37e26bd0b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932c51eb-8285-43d9-baec-4ad35b728637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932c51eb-8285-43d9-baec-4ad35b728637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1729814892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf3e440-679c-40ab-a9b6-ec1c690cbda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28028dcf-6ae4-474e-b0a8-6b4aa113e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28028dcf-6ae4-474e-b0a8-6b4aa113e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73556920-2f83-49de-bb88-c5288e30429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73556920-2f83-49de-bb88-c5288e30429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf3e440-679c-40ab-a9b6-ec1c690cbda8', 'volume_name': 'volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6552e3f6-90ff-401e-af9a-f9eba91cffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6552e3f6-90ff-401e-af9a-f9eba91cffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab112bc7-1c72-40ef-bddf-1e7de79c3015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume bbf3e440-679c-40ab-a9b6-ec1c690cbda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8', 'volume_size': 1}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Created reservations ['8f3f145e-5058-44be-a8f5-6fd1815f0429', '4071b9e5-71f6-4af3-81f1-28672899541c', 'b8a7d334-9c84-4d3a-85ba-f48e40bbf4a6', '0f67f640-fe72-4e3a-9191-4870355754dc'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:21 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:21 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (a8fbeff8-2904-495c-aa92-897da0ce25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905f84e9-6372-4f2b-96de-5bc7df1ad281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905f84e9-6372-4f2b-96de-5bc7df1ad281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518723479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77e44e2-ef3c-439d-8b51-6f62ae837882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34942631-8696-4e9f-97b8-6273d9eef6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34942631-8696-4e9f-97b8-6273d9eef6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6227fbc-d448-4c16-81d9-4e4fd84ead88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:21 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6227fbc-d448-4c16-81d9-4e4fd84ead88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77e44e2-ef3c-439d-8b51-6f62ae837882', 'volume_name': 'volume-c77e44e2-ef3c-439d-8b51-6f62ae837882', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13da660c-ea7d-48e9-9042-bd252812b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13da660c-ea7d-48e9-9042-bd252812b721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85911dab-9bd5-4b5a-ae4d-017b8fca2ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume c77e44e2-ef3c-439d-8b51-6f62ae837882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77e44e2-ef3c-439d-8b51-6f62ae837882', 'volume_size': 1}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (a8f16ea0-1484-40ee-a8ea-b956918f88b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a344fa-b71f-45d8-a46f-deebaa07dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a344fa-b71f-45d8-a46f-deebaa07dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178591334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0366c3-fa7c-46ca-9ec6-84f22b020cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f36634-8ece-4f0b-b8ba-18e4d43c1887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f36634-8ece-4f0b-b8ba-18e4d43c1887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255879d1-73fc-440a-941c-ba9f20a5cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255879d1-73fc-440a-941c-ba9f20a5cd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0366c3-fa7c-46ca-9ec6-84f22b020cb0', 'volume_name': 'volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f71cf0c-def0-4c93-9445-38f474700e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f71cf0c-def0-4c93-9445-38f474700e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b44b22-3c3f-4f44-88e7-8bbfee33364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:22 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume af0366c3-fa7c-46ca-9ec6-84f22b020cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0', 'volume_size': 1}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:22 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.979s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:22 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Deleted volume successfully.
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-c91e1204-c73f-443b-ab56-fc805c844c7d-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-356f686b-5e3b-458f-8683-9a326c5aefb1 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-30040056-1216-4ae3-b491-6e81617b43f6-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:22 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-c91e1204-c73f-443b-ab56-fc805c844c7d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "cinder-quobyte-c91e1204-c73f-443b-ab56-fc805c844c7d" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-c91e1204-c73f-443b-ab56-fc805c844c7d" acquired by "delete_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[985795af-8fa2-44f3-b5fd-975ab0569ad3]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:23 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d
Apr 09 10:48:23 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:23 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1" returned: 0 in 2.233s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4496b-a396-4498-ad09-38e491b53c6f]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:23 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:23 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:23 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:24 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d" returned: 0 in 0.926s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:24 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d
Apr 09 10:48:24 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:24 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c91e1204-c73f-443b-ab56-fc805c844c7d" returned: 0 in 0.412s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-quobyte-c91e1204-c73f-443b-ab56-fc805c844c7d" released by "delete_volume" :: held 1.385s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Created reservations ['d63a11a8-ca56-4b14-8144-d6b0c9060f17', '1268be50-80a0-4f94-8da0-1cbc66d6e50e', 'f749100f-a664-4069-8eec-8acfbc803291', 'd64cec9e-7693-484b-aa53-474bcd5c888f'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:24 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:24 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:24 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.638s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:48:24 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Converted 1024.00 MB image at 458.25 MB/s
Apr 09 10:48:24 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 is being set with open permissions: ugo+rw
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:24 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1
Apr 09 10:48:24 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:24 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.464s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:24 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Deleted volume successfully.
Apr 09 10:48:24 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-03e04f74-bf73-495b-b765-f321130a2a44 tempest-CreateVolumesFromImageTest-391736615 None] Lock "cinder-c91e1204-c73f-443b-ab56-fc805c844c7d-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:25 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1" returned: 0 in 0.469s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-293a4bab-305c-45c8-9152-d56de70f99e1" released by "_copy_volume_from_snapshot" :: held 4.628s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d-293a4bab-305c-45c8-9152-d56de70f99e1" released by "_create_volume_from_snapshot" :: held 4.647s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.667s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.594s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1494981856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbb4180-0271-43ca-a8cd-af1c936014d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7ba43f056249768c3661609c51538f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:19Z,use_quota=True,user_id='1f2dd549e07a49cd951674d506e572c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Creating volume 3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:25 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:25 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 1073741824
Apr 09 10:48:25 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acdf6dc-991f-427c-a745-db43d995a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293a4bab-305c-45c8-9152-d56de70f99e1', 'volume_size': 1, 'snapshot_id': 'f9ed6294-27fe-46ee-b0cc-78ac44a27b0d'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb94f65-f90f-4ed3-8fd3-9ea53c1a0590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:25 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Volume volume-293a4bab-305c-45c8-9152-d56de70f99e1 (293a4bab-305c-45c8-9152-d56de70f99e1): created successfully
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb94f65-f90f-4ed3-8fd3-9ea53c1a0590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (9ed7e3a5-546a-4cd2-9e42-d296bca58067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:25 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-8980f2fe-0267-48a3-810d-8c6cefc93116 tempest-VolumeDependencyTests-997215210 None] Created volume successfully.
Apr 09 10:48:25 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 1073741824" returned: 0 in 0.603s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:25 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:25 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-84707647-8d9c-4dd6-9e39-1b8c2e639191" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-84707647-8d9c-4dd6-9e39-1b8c2e639191" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Deleting offline snapshot f9ed6294-27fe-46ee-b0cc-78ac44a27b0d of volume 84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] snapshot_file for this snap is: volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da2475-e205-4139-b376-2fd3d84f3d5b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:25 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:26 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d
Apr 09 10:48:26 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:26 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.651s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060663947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d84b13-07fa-4520-97d3-b399e8a12a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:21Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating volume f5d84b13-07fa-4520-97d3-b399e8a12a64 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:26 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cac2cb-aeb4-4758-ab40-21241e41cbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbb4180-0271-43ca-a8cd-af1c936014d1', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abd45ab-4ad2-4a99-954f-ee2166d61009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:26 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 1073741824
Apr 09 10:48:26 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Volume volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 (3bbb4180-0271-43ca-a8cd-af1c936014d1): created successfully
Apr 09 10:48:26 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abd45ab-4ad2-4a99-954f-ee2166d61009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Flow 'volume_create_manager' (873840c0-59dd-4dc1-8a4a-4a9f060a4fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:26 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ded9fda8-cd86-47f1-876d-4883e06515a0 tempest-SnapshotDependencyTests-1909497001 None] Created volume successfully.
Apr 09 10:48:26 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84707647-8d9c-4dd6-9e39-1b8c2e639191(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf6ff54-9e25-4a2b-94b6-38ad94ae5a24]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:26 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:26 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:26 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 1073741824" returned: 0 in 0.599s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:26 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64
Apr 09 10:48:26 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (9d5f76b6-dd95-4165-8c7a-563554168498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6b7c40-785d-442e-a9cf-e78db4488e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6b7c40-785d-442e-a9cf-e78db4488e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468157878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41f5feb-7d05-4bf6-8cf4-a8a811012bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:27Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0d5c38-b716-4388-8f53-ed2660c0c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0d5c38-b716-4388-8f53-ed2660c0c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0826699-4f89-4185-b321-e73d4b043889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0826699-4f89-4185-b321-e73d4b043889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41f5feb-7d05-4bf6-8cf4-a8a811012bc5', 'volume_name': 'volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f40885-0389-487d-891b-9ddb868bcc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f40885-0389-487d-891b-9ddb868bcc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158f4894-fe37-4b65-b812-2a4d0032b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:26 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume b41f5feb-7d05-4bf6-8cf4-a8a811012bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5', 'volume_size': 1}
Apr 09 10:48:26 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:27 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.653s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:27 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d
Apr 09 10:48:27 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:27 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64" returned: 0 in 0.482s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.624s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732586630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating volume 47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:27 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87f9a70-301e-449d-8b26-66ee059ee80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d84b13-07fa-4520-97d3-b399e8a12a64', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb8b708-9ff3-48b9-9edf-3df6cfe2f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:27 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 1073741824
Apr 09 10:48:27 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:27 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 (f5d84b13-07fa-4520-97d3-b399e8a12a64): created successfully
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb8b708-9ff3-48b9-9edf-3df6cfe2f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (a0717d9c-fe68-4734-8f96-7463f9ce3f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:27 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-584bf668-360f-4cc7-b0db-823af500bd0b tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created volume successfully.
Apr 09 10:48:27 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" returned: 0 in 0.467s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:27 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d
Apr 09 10:48:27 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:27 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 1073741824" returned: 0 in 0.524s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:27 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:27 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388
Apr 09 10:48:27 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:28 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191.f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d" released by "_delete_snapshot" :: held 2.217s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-84707647-8d9c-4dd6-9e39-1b8c2e639191" released by "delete_snapshot" :: held 2.256s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Created reservations ['42fcc451-0cfd-4869-b90a-55f7fdc37e8f', '6b4bd0b9-aa3e-4bf6-a992-c0b172200f33', '784bfa52-8326-4ffb-bf3e-2048a34fdf51', '2c87cf9b-2613-4172-9393-e5b7a53fa081'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:28 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Delete snapshot completed successfully.
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bc511ada-b176-4832-885e-22f0f2db8a82 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-f9ed6294-27fe-46ee-b0cc-78ac44a27b0d-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:28 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388" returned: 0 in 0.447s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.440s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1729814892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf3e440-679c-40ab-a9b6-ec1c690cbda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating volume bbf3e440-679c-40ab-a9b6-ec1c690cbda8 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:28 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30df426-1388-4dee-8b84-c13fe683f8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:28 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 1073741824
Apr 09 10:48:28 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2decdfca-6366-4a42-9c55-67cfa9bdbe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:28 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 (47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388): created successfully
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2decdfca-6366-4a42-9c55-67cfa9bdbe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (0afecf40-731a-4fd4-bd00-17ce4358c754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:28 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ff89ab75-e3ac-43e9-8c7e-cc0c1644d668 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created volume successfully.
Apr 09 10:48:28 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 1073741824" returned: 0 in 0.501s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:28 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8
Apr 09 10:48:28 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:28 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-84707647-8d9c-4dd6-9e39-1b8c2e639191-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-84707647-8d9c-4dd6-9e39-1b8c2e639191-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-84707647-8d9c-4dd6-9e39-1b8c2e639191" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-84707647-8d9c-4dd6-9e39-1b8c2e639191" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b322d-e622-4a44-a2bc-a711ed83e6f2]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:29 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:29 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:29 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8" returned: 0 in 0.451s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.251s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518723479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77e44e2-ef3c-439d-8b51-6f62ae837882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating volume c77e44e2-ef3c-439d-8b51-6f62ae837882 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:29 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab112bc7-1c72-40ef-bddf-1e7de79c3015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:29 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 1073741824
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8f938b-6b43-4b9a-b8dd-045b86a7da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:29 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:29 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 (bbf3e440-679c-40ab-a9b6-ec1c690cbda8): created successfully
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8f938b-6b43-4b9a-b8dd-045b86a7da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (5e96b658-e417-469f-9052-37e26bd0b456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:29 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-13cb8ff6-5409-47b9-b13a-f9c3cfdad870 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created volume successfully.
Apr 09 10:48:29 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:29 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191
Apr 09 10:48:29 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:29 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 1073741824" returned: 0 in 0.512s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:29 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:29 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882
Apr 09 10:48:29 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:30 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-84707647-8d9c-4dd6-9e39-1b8c2e639191" returned: 0 in 0.460s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-84707647-8d9c-4dd6-9e39-1b8c2e639191" released by "delete_volume" :: held 0.990s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Created reservations ['c07b285d-e0d3-4c35-8ad8-7fd32db15af2', 'a5d7f91e-5239-434d-8f38-588350ccb9a0', '51a1edfd-14d2-4d72-b005-46d0dd93ae6f', 'e79f5278-f154-49b5-9de6-8ecc6f5fb8bb'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:30 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:30 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:30 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.823s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178591334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0366c3-fa7c-46ca-9ec6-84f22b020cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbc893949c24167b7af348fcc06823a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:22Z,use_quota=True,user_id='113147c2d31540999e13b799c6751a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Creating volume af0366c3-fa7c-46ca-9ec6-84f22b020cb0 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:30 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85911dab-9bd5-4b5a-ae4d-017b8fca2ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77e44e2-ef3c-439d-8b51-6f62ae837882', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:30 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 1073741824
Apr 09 10:48:30 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68bfb9-0e2f-46bf-8e04-88c21a4508a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:30 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 (c77e44e2-ef3c-439d-8b51-6f62ae837882): created successfully
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68bfb9-0e2f-46bf-8e04-88c21a4508a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (a8fbeff8-2904-495c-aa92-897da0ce25d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:30 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-90b163b6-bf68-4732-953c-7bc8421a3860 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created volume successfully.
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (0d7fe317-3fd1-41a4-85ec-962a81d7514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce99a0b-0a38-4789-b6f7-e56173984835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce99a0b-0a38-4789-b6f7-e56173984835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1309499773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5479838d-8cd1-472a-812e-319737ee8237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d525dea584494ca9f7991174b66236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:30Z,use_quota=True,user_id='3e5e746c62e844b58fb51df7b84a26ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c400f7f4-104e-4c9c-8fc0-268020ce1200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c400f7f4-104e-4c9c-8fc0-268020ce1200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27466882-f288-42de-aa62-56d1d6721969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27466882-f288-42de-aa62-56d1d6721969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5479838d-8cd1-472a-812e-319737ee8237', 'volume_name': 'volume-5479838d-8cd1-472a-812e-319737ee8237', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b03daa3-fb7e-4c61-a474-414c54fefd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b03daa3-fb7e-4c61-a474-414c54fefd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae03faba-5feb-4cdd-a7d4-fe03f32c2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:30 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Volume 5479838d-8cd1-472a-812e-319737ee8237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5479838d-8cd1-472a-812e-319737ee8237', 'volume_size': 1}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:30 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.447s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:30 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Deleted volume successfully.
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-b0392f55-0497-44a2-85ed-e27c5f8c9784 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-84707647-8d9c-4dd6-9e39-1b8c2e639191-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:30 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 1073741824" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:30 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:30 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0
Apr 09 10:48:30 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:31 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0" returned: 0 in 0.409s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.260s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468157878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41f5feb-7d05-4bf6-8cf4-a8a811012bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:27Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Creating volume b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:31 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b44b22-3c3f-4f44-88e7-8bbfee33364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eca1202-9019-42dd-bc73-113cb34c543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:31 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 1073741824
Apr 09 10:48:31 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:31 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Volume volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 (af0366c3-fa7c-46ca-9ec6-84f22b020cb0): created successfully
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eca1202-9019-42dd-bc73-113cb34c543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Flow 'volume_create_manager' (a8f16ea0-1484-40ee-a8ea-b956918f88b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:31 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-038fbc2d-4cc5-4136-990d-0f7a87f9549d tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created volume successfully.
Apr 09 10:48:31 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 1073741824" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:31 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5
Apr 09 10:48:31 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-af0366c3-fa7c-46ca-9ec6-84f22b020cb0-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-af0366c3-fa7c-46ca-9ec6-84f22b020cb0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-af0366c3-fa7c-46ca-9ec6-84f22b020cb0" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-af0366c3-fa7c-46ca-9ec6-84f22b020cb0" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8f9926-a34b-47ad-b0f7-108b722826eb]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:31 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:32 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0
Apr 09 10:48:32 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:32 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5" returned: 0 in 0.454s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.990s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158f4894-fe37-4b65-b812-2a4d0032b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d06acb1-4386-4d3a-919a-573cda0e99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Creating offline snapshot d5815800-8a1b-40cd-b1f0-f5ba46095216 of volume 3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:48:32 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 (b41f5feb-7d05-4bf6-8cf4-a8a811012bc5): created successfully
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d06acb1-4386-4d3a-919a-573cda0e99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (9d5f76b6-dd95-4165-8c7a-563554168498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74fcf44-9334-4be5-8046-879d0d2cc0d1]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:32 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-54f75b49-048c-439c-a2b7-8f3ba7707a76 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created volume successfully.
Apr 09 10:48:32 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:32 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:32 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:32 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0
Apr 09 10:48:32 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:32 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.500s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:32 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 1G
Apr 09 10:48:32 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:32 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-af0366c3-fa7c-46ca-9ec6-84f22b020cb0" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-af0366c3-fa7c-46ca-9ec6-84f22b020cb0" released by "delete_volume" :: held 0.962s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['b0b574ac-ed7b-4e9e-a7b3-00c17f9ebeca', '4c4c73c8-d4b9-4491-884b-abfe40dd69bd', '372c13b4-0e4f-44fb-9cc3-bae9a50aa377', 'a132f26c-8d79-4a34-b644-27dde0113f40'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:32 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:33 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:33 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-c77e44e2-ef3c-439d-8b51-6f62ae837882-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-c77e44e2-ef3c-439d-8b51-6f62ae837882-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-c77e44e2-ef3c-439d-8b51-6f62ae837882" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-c77e44e2-ef3c-439d-8b51-6f62ae837882" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8abce1d-ff15-4a66-9457-5f0b6e1512c7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:33 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882
Apr 09 10:48:33 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:33 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 1G" returned: 0 in 0.555s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:33 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216
Apr 09 10:48:33 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:33 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (07b0c738-24af-459c-9b06-89dc98b5fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8834346a-eac9-46a3-afe2-132759f5f04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.531s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8834346a-eac9-46a3-afe2-132759f5f04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-24027323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23430f2-9cf3-469d-888f-8be735917dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:33Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf967ae-d05d-4668-af70-e144b4239be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf967ae-d05d-4668-af70-e144b4239be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa61fdf-5f36-4445-8b50-4b032870860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa61fdf-5f36-4445-8b50-4b032870860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23430f2-9cf3-469d-888f-8be735917dad', 'volume_name': 'volume-f23430f2-9cf3-469d-888f-8be735917dad', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77749919-d923-4ffe-b4bc-e11300948e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77749919-d923-4ffe-b4bc-e11300948e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c2c100-6287-4ae3-acab-872fdfc261c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume f23430f2-9cf3-469d-888f-8be735917dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23430f2-9cf3-469d-888f-8be735917dad', 'volume_size': 1}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:33 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleted volume successfully.
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-91211cf4-c28b-4f4c-b560-4a2af5f7a0a5 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-af0366c3-fa7c-46ca-9ec6-84f22b020cb0-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (efdbb254-c2ca-4042-86f0-a30000987dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256a8858-92fb-44ca-9ff0-8c2a5da36db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256a8858-92fb-44ca-9ff0-8c2a5da36db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010246069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb48e01-71bf-4230-92d6-475dce3bd6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc7d5e2-be15-46a7-ac84-db9017d5bb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc7d5e2-be15-46a7-ac84-db9017d5bb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d5162e-af26-4609-89c2-2c331b731e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d5162e-af26-4609-89c2-2c331b731e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb48e01-71bf-4230-92d6-475dce3bd6df', 'volume_name': 'volume-3bb48e01-71bf-4230-92d6-475dce3bd6df', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef19b2d1-cce6-4623-9e1c-e8c173568b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef19b2d1-cce6-4623-9e1c-e8c173568b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d934f5bc-a841-428b-b0c5-dd506fa69a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume 3bb48e01-71bf-4230-92d6-475dce3bd6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb48e01-71bf-4230-92d6-475dce3bd6df', 'volume_size': 1}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882" returned: 0 in 0.639s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:33 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882
Apr 09 10:48:33 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:33 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216" returned: 0 in 0.581s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:33 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 is being set with open permissions: ugo+rw
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:33 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216
Apr 09 10:48:33 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (4fededd7-ccc2-4511-ae12-12e3e10867a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42852dae-9042-44d3-ae04-0e2d5b837d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42852dae-9042-44d3-ae04-0e2d5b837d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13293935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84117737-5e95-4f7f-b6be-18d7019905d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84117737-5e95-4f7f-b6be-18d7019905d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4efc25d-06a2-404b-b733-28a5d95fd863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4efc25d-06a2-404b-b733-28a5d95fd863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783', 'volume_name': 'volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f40614-9b62-408e-9b28-2f990f602c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f40614-9b62-408e-9b28-2f990f602c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb72e45d-51bb-464e-bbe9-61670125199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:33 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783', 'volume_size': 1}
Apr 09 10:48:33 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (c65b64fb-f812-4219-b86c-8f262d2e1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6931bda-c30d-4e1d-a810-5d325cb60f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6931bda-c30d-4e1d-a810-5d325cb60f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819325322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740b8fb4-fd6d-4351-b952-18d4dbd50f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10182efa-4d52-4a34-8591-6526827659ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10182efa-4d52-4a34-8591-6526827659ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8a5681-0966-4b6e-976a-b59e6de6571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8a5681-0966-4b6e-976a-b59e6de6571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740b8fb4-fd6d-4351-b952-18d4dbd50f1a', 'volume_name': 'volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8ddb80-4519-452b-ae01-5b43a05f1bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8ddb80-4519-452b-ae01-5b43a05f1bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf69f6fb-d3cc-4795-94d6-a3acc81954ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume 740b8fb4-fd6d-4351-b952-18d4dbd50f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a', 'volume_size': 1}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (c52b3d90-7005-497a-bffc-f1eaa51f2bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a873def1-9563-409d-9ad4-f8dcbc70639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a873def1-9563-409d-9ad4-f8dcbc70639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354450707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07fcf89-92bb-48fd-a413-7f49aac40418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa597f1-b32f-41b0-a9e6-732ce1721eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa597f1-b32f-41b0-a9e6-732ce1721eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcdc185-2e2c-4469-a0ad-15f36a17a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcdc185-2e2c-4469-a0ad-15f36a17a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07fcf89-92bb-48fd-a413-7f49aac40418', 'volume_name': 'volume-e07fcf89-92bb-48fd-a413-7f49aac40418', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61ed651-41bd-4383-b86f-704e0dd7140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61ed651-41bd-4383-b86f-704e0dd7140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eda5156-d4ac-42cd-a7ee-52496fffb6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:34 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:34 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume e07fcf89-92bb-48fd-a413-7f49aac40418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07fcf89-92bb-48fd-a413-7f49aac40418', 'volume_size': 1}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-c77e44e2-ef3c-439d-8b51-6f62ae837882" returned: 0 in 0.585s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216" returned: 0 in 0.516s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-c77e44e2-ef3c-439d-8b51-6f62ae837882" released by "delete_volume" :: held 1.248s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:34 devstack sudo[90497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info
Apr 09 10:48:34 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['137b97d2-0a7e-454e-9882-d77b00d3529d', '8c2e58aa-1ddd-447f-9087-154837285b00', 'a4fa5454-a75c-4176-87cc-b33493c59b2f', 'fbc06898-833c-4a29-b5ec-b38f8a44e3c9'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:34 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:34 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:34 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info" returned: 0 in 0.440s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:34 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info is being set with open permissions: ugo+rw
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:34 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info
Apr 09 10:48:34 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:34 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.427s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:34 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleted volume successfully.
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:UPDATE=221,cinder:DELETE=23,cinder:SELECT=163,cinder:INSERT=65 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:48:34 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-769b8b0b-300d-4d47-b344-ae0e1f83a3bb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-c77e44e2-ef3c-439d-8b51-6f62ae837882-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-bbf3e440-679c-40ab-a9b6-ec1c690cbda8-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-bbf3e440-679c-40ab-a9b6-ec1c690cbda8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:UPDATE=213,cinder:SELECT=147,cinder:INSERT=34,cinder:DELETE=18 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-bbf3e440-679c-40ab-a9b6-ec1c690cbda8" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-bbf3e440-679c-40ab-a9b6-ec1c690cbda8" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd45f76e-cb00-4042-902b-d88fcfe7cb60]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:35 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.info" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1309499773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5479838d-8cd1-472a-812e-319737ee8237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d525dea584494ca9f7991174b66236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:30Z,use_quota=True,user_id='3e5e746c62e844b58fb51df7b84a26ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Creating volume 5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:35 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:35 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 1073741824
Apr 09 10:48:35 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:35 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-0caa96f6-e78b-4145-934c-8c9165a17230 tempest-SnapshotDependencyTests-1909497001 None] Create snapshot completed successfully
Apr 09 10:48:35 devstack sudo[90506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8
Apr 09 10:48:35 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Flow 'volume_create_manager' (d80159a9-3ee0-4c60-92ba-6f7eda4642b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edda889-34e6-45ac-9d37-eb633ea09f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edda889-34e6-45ac-9d37-eb633ea09f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67efa41b-85f2-4844-b260-9273077a91ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7ba43f056249768c3661609c51538f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5815800-8a1b-40cd-b1f0-f5ba46095216,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:36Z,use_quota=True,user_id='1f2dd549e07a49cd951674d506e572c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a96d2b9-77b3-46b9-8667-64fc5106057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a96d2b9-77b3-46b9-8667-64fc5106057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35616e1-2de2-4d69-b847-b4badc832e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35616e1-2de2-4d69-b847-b4badc832e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67efa41b-85f2-4844-b260-9273077a91ea', 'volume_name': 'volume-67efa41b-85f2-4844-b260-9273077a91ea', 'volume_size': 1, 'snapshot_id': 'd5815800-8a1b-40cd-b1f0-f5ba46095216'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722ff1e2-cfa2-41b4-9d43-7fc5ec0963b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722ff1e2-cfa2-41b4-9d43-7fc5ec0963b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b472ad-dab5-4f6e-965c-6f2a0b560ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:35 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Volume 67efa41b-85f2-4844-b260-9273077a91ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67efa41b-85f2-4844-b260-9273077a91ea', 'volume_size': 1, 'snapshot_id': 'd5815800-8a1b-40cd-b1f0-f5ba46095216'}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:35 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 1073741824" returned: 0 in 0.540s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:35 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8" returned: 0 in 0.605s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:35 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:35 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:35 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:35 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8
Apr 09 10:48:35 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:36 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:36 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-24027323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23430f2-9cf3-469d-888f-8be735917dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:33Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Creating volume f23430f2-9cf3-469d-888f-8be735917dad {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:36 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-bbf3e440-679c-40ab-a9b6-ec1c690cbda8" returned: 0 in 0.447s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:36 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad 1073741824
Apr 09 10:48:36 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae03faba-5feb-4cdd-a7d4-fe03f32c2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5479838d-8cd1-472a-812e-319737ee8237', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dee51bd-3818-4b5e-9cf1-9d2b58beb981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:36 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Volume volume-5479838d-8cd1-472a-812e-319737ee8237 (5479838d-8cd1-472a-812e-319737ee8237): created successfully
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dee51bd-3818-4b5e-9cf1-9d2b58beb981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (0d7fe317-3fd1-41a4-85ec-962a81d7514d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-bbf3e440-679c-40ab-a9b6-ec1c690cbda8" released by "delete_volume" :: held 1.122s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-d574f2b4-06f6-403d-ab49-3609b0155f64 tempest-VolumeDependencyTests-997215210 None] Created volume successfully.
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['19e9454e-4fe1-4296-a6df-19c63041fb96', '0c6d95b8-367e-4cd1-99f8-d0f3b7dc4f74', 'f8f5894a-7b6d-4aba-ac29-8dc3a7096cf8', 'fc3fc85a-6d09-4993-8114-267019275a54'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:36 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:36 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:36 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad 1073741824" returned: 0 in 0.582s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:36 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.464s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:36 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleted volume successfully.
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:36 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-4c2d07b8-d16a-49aa-beaa-801d32ec8965 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-bbf3e440-679c-40ab-a9b6-ec1c690cbda8-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:36 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad
Apr 09 10:48:36 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (c0fd869f-98ae-4dec-acb6-4bf323001055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07ad923-a874-42bb-b6c3-0c76b7cdc230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07ad923-a874-42bb-b6c3-0c76b7cdc230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-776599098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099dbcb4-beac-4b0e-9b43-57e6fc323371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d525dea584494ca9f7991174b66236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5479838d-8cd1-472a-812e-319737ee8237,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:37Z,use_quota=True,user_id='3e5e746c62e844b58fb51df7b84a26ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f7a2ea-cce0-4fed-941d-4521f61fb1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f7a2ea-cce0-4fed-941d-4521f61fb1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f881d5-782a-4f44-a731-fbd7524e45ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f881d5-782a-4f44-a731-fbd7524e45ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '099dbcb4-beac-4b0e-9b43-57e6fc323371', 'volume_name': 'volume-099dbcb4-beac-4b0e-9b43-57e6fc323371', 'volume_size': 1, 'source_volid': '5479838d-8cd1-472a-812e-319737ee8237', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca2cd0a-0810-4796-828b-bd7baf8063bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca2cd0a-0810-4796-828b-bd7baf8063bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7259f1b0-a428-493c-984f-b30e7fecdc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Volume 099dbcb4-beac-4b0e-9b43-57e6fc323371: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-099dbcb4-beac-4b0e-9b43-57e6fc323371', 'volume_size': 1, 'source_volid': '5479838d-8cd1-472a-812e-319737ee8237', 'source_volstatus': 'available'}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:37 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad" returned: 0 in 0.439s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.589s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010246069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb48e01-71bf-4230-92d6-475dce3bd6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Creating volume 3bb48e01-71bf-4230-92d6-475dce3bd6df {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:37 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:37 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df 1073741824
Apr 09 10:48:37 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c2c100-6287-4ae3-acab-872fdfc261c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23430f2-9cf3-469d-888f-8be735917dad', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487a946b-557f-4f2e-8914-6655f54b6aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:37 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume volume-f23430f2-9cf3-469d-888f-8be735917dad (f23430f2-9cf3-469d-888f-8be735917dad): created successfully
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487a946b-557f-4f2e-8914-6655f54b6aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (07b0c738-24af-459c-9b06-89dc98b5fbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:37 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ad114156-d42f-4c27-a7a5-ed9f57e86e54 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created volume successfully.
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9848e4e0-d327-457c-bbe8-47f144b0d473]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:37 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388
Apr 09 10:48:37 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:37 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df 1073741824" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:37 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:38 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df
Apr 09 10:48:38 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:38 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:38 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388
Apr 09 10:48:38 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:38 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df" returned: 0 in 0.430s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.427s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13293935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Creating volume f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:38 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d934f5bc-a841-428b-b0c5-dd506fa69a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb48e01-71bf-4230-92d6-475dce3bd6df', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:38 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 1073741824
Apr 09 10:48:38 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75f6cf6-980d-4108-a7e2-11cce3836efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:38 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:38 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume volume-3bb48e01-71bf-4230-92d6-475dce3bd6df (3bb48e01-71bf-4230-92d6-475dce3bd6df): created successfully
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75f6cf6-980d-4108-a7e2-11cce3836efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (efdbb254-c2ca-4042-86f0-a30000987dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388" returned: 0 in 0.440s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:38 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-e9037a87-0b94-4fea-8020-c928b88baa84 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created volume successfully.
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388" released by "delete_volume" :: held 0.984s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['a5742480-82fd-4f71-ad35-bd3a61f3dece', '00202b3d-82c4-4fa0-8940-845cb170b025', '8edecaba-5ac7-48df-bcba-bbb6da60f518', 'f69debc8-a2ef-43d5-8d24-05a999b909b1'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:38 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:38 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:38 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 1073741824" returned: 0 in 0.532s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:38 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:38 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783
Apr 09 10:48:38 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:39 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.463s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:39 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleted volume successfully.
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-d4608464-5e9c-48a0-9841-6ed8a9172827 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-47c2a8a5-b44e-4fe7-a8d9-ab9b449fe388-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:39 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.235s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819325322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740b8fb4-fd6d-4351-b952-18d4dbd50f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Creating volume 740b8fb4-fd6d-4351-b952-18d4dbd50f1a {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:39 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb72e45d-51bb-464e-bbe9-61670125199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc5d42-f01e-4533-990e-075bd288fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:39 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a 1073741824
Apr 09 10:48:39 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:39 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 (f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783): created successfully
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc5d42-f01e-4533-990e-075bd288fd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (4fededd7-ccc2-4511-ae12-12e3e10867a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:39 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-eed34e51-aefe-4051-8824-5c3c4bec2b0b tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created volume successfully.
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_service.periodic_task [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82783) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:39 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:39 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-f5d84b13-07fa-4520-97d3-b399e8a12a64-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-f5d84b13-07fa-4520-97d3-b399e8a12a64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-f5d84b13-07fa-4520-97d3-b399e8a12a64" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-f5d84b13-07fa-4520-97d3-b399e8a12a64" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb7d730-9b79-4975-90f6-942df28a2c50]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:39 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64
Apr 09 10:48:39 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:39 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:39 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a 1073741824" returned: 0 in 0.571s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:40 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.533s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-e17e18d3-785a-45e9-bc9c-cb2e1f9f2c9e None None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:40 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a
Apr 09 10:48:40 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:40 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:40 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64
Apr 09 10:48:40 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:40 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a" returned: 0 in 0.434s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.064s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354450707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07fcf89-92bb-48fd-a413-7f49aac40418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b050fb0ec5746aeafe19a27209f4b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:34Z,use_quota=True,user_id='d4f9221311ba49b68c465093b9f0a0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Creating volume e07fcf89-92bb-48fd-a413-7f49aac40418 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:40 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf69f6fb-d3cc-4795-94d6-a3acc81954ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b95e5e-c8b5-4a97-b0bb-18287255699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:40 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418 1073741824
Apr 09 10:48:40 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:40 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a (740b8fb4-fd6d-4351-b952-18d4dbd50f1a): created successfully
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b95e5e-c8b5-4a97-b0bb-18287255699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (c65b64fb-f812-4219-b86c-8f262d2e1828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:40 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-461ebab4-b65a-4521-b63e-39644b9fb09c tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created volume successfully.
Apr 09 10:48:40 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f5d84b13-07fa-4520-97d3-b399e8a12a64" returned: 0 in 0.415s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-f5d84b13-07fa-4520-97d3-b399e8a12a64" released by "delete_volume" :: held 0.957s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['895c2547-6819-46ec-84cd-e561b645d38c', 'fa8a5dee-6c53-4567-a584-a6191285f9d9', '7db60808-1caa-49d1-991a-72a44c17fe54', '5c7f696a-1bdf-43ac-9c53-d9b6373729c9'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:40 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:40 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:40 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:40 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418 1073741824" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:41 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418
Apr 09 10:48:41 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:41 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.436s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleted volume successfully.
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-752f9655-cf85-4ba5-9248-af008b0ad7b7 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-f5d84b13-07fa-4520-97d3-b399e8a12a64-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:41 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418" returned: 0 in 0.407s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.565s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-quobyte-d5815800-8a1b-40cd-b1f0-f5ba46095216-67efa41b-85f2-4844-b260-9273077a91ea" by "_create_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eda5156-d4ac-42cd-a7ee-52496fffb6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07fcf89-92bb-48fd-a413-7f49aac40418', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a9fa45-b915-4fdc-9ea2-5ca8e25bc1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:41 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Volume volume-e07fcf89-92bb-48fd-a413-7f49aac40418 (e07fcf89-92bb-48fd-a413-7f49aac40418): created successfully
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a9fa45-b915-4fdc-9ea2-5ca8e25bc1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Flow 'volume_create_manager' (c52b3d90-7005-497a-bffc-f1eaa51f2bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-d5815800-8a1b-40cd-b1f0-f5ba46095216-67efa41b-85f2-4844-b260-9273077a91ea" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Creating volume 67efa41b-85f2-4844-b260-9273077a91ea from snapshot d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-quobyte-67efa41b-85f2-4844-b260-9273077a91ea" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3c5dbc86-f2bd-4c3c-a9ba-cbe484efb0af tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created volume successfully.
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-67efa41b-85f2-4844-b260-9273077a91ea" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] snapshot: d5815800-8a1b-40cd-b1f0-f5ba46095216, volume: 67efa41b-85f2-4844-b260-9273077a91ea,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c82bcf-0851-43fb-a3a0-d46a8372b10a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:41 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216
Apr 09 10:48:41 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-9d528b01-697c-439d-857d-2df928d8c57f-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-9d528b01-697c-439d-857d-2df928d8c57f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-6de216ec-bc20-4c16-9f19-714d3230b93a" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-6de216ec-bc20-4c16-9f19-714d3230b93a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-9d528b01-697c-439d-857d-2df928d8c57f" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-9d528b01-697c-439d-857d-2df928d8c57f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleting offline snapshot 9d528b01-697c-439d-857d-2df928d8c57f of volume 6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] snapshot_file for this snap is: volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d3d31-650b-412d-8c61-83884e409b1e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:41 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f
Apr 09 10:48:41 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-e07fcf89-92bb-48fd-a413-7f49aac40418-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-e07fcf89-92bb-48fd-a413-7f49aac40418-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-quobyte-e07fcf89-92bb-48fd-a413-7f49aac40418" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-e07fcf89-92bb-48fd-a413-7f49aac40418" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[504905e4-27a4-4ce2-8292-6a52423cc8ae]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:41 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:42 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418
Apr 09 10:48:42 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:42 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216" returned: 0 in 0.592s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bbb4180-0271-43ca-a8cd-af1c936014d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9f7c1-bdfb-4777-9719-68c93a57ba33]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:42 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:42 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:42 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f" returned: 0 in 0.532s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de216ec-bc20-4c16-9f19-714d3230b93a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395656a-516b-4597-ad75-6fe54f4fe420]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:42 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a
Apr 09 10:48:42 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:42 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418" returned: 0 in 0.520s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:42 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418
Apr 09 10:48:42 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:42 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.510s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:42 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea
Apr 09 10:48:42 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:42 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a" returned: 0 in 0.545s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:42 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f
Apr 09 10:48:42 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:42 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-e07fcf89-92bb-48fd-a413-7f49aac40418" returned: 0 in 0.441s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-e07fcf89-92bb-48fd-a413-7f49aac40418" released by "delete_volume" :: held 0.984s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:42 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created reservations ['b90cad6f-97a4-4154-9014-8baf00412cf1', '869565b4-42f7-4c2b-815a-540b8f8f2752', 'c99bc258-d9de-4e30-8c9a-2c180479459a', 'ffe695b9-6401-4ed5-9f37-c1c68bbc3464'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:43 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:43 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-740b8fb4-fd6d-4351-b952-18d4dbd50f1a-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-740b8fb4-fd6d-4351-b952-18d4dbd50f1a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-quobyte-740b8fb4-fd6d-4351-b952-18d4dbd50f1a" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-740b8fb4-fd6d-4351-b952-18d4dbd50f1a" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97a7410-597a-4274-b0a1-d54d795f8479]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:43 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:43 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a
Apr 09 10:48:43 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:44 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 1.011s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:44 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Deleted volume successfully.
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f6f011e0-72f5-4454-bdeb-d6c5d1e41a00 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-e07fcf89-92bb-48fd-a413-7f49aac40418-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:44 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f" returned: 0 in 1.548s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:44 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f
Apr 09 10:48:44 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:44 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a" returned: 0 in 1.575s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:44 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:44 devstack sudo[90651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a
Apr 09 10:48:44 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:45 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea" returned: 0 in 2.439s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d87035-605d-4eef-aac6-a60182e34b9d]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:45 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:45 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:45 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a.9d528b01-697c-439d-857d-2df928d8c57f" returned: 0 in 0.785s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-9d528b01-697c-439d-857d-2df928d8c57f" released by "_delete_snapshot" :: held 3.466s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-6de216ec-bc20-4c16-9f19-714d3230b93a" released by "delete_snapshot" :: held 3.481s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['91f2596c-44fc-41e3-a0c2-27511053be62', '5d5bde10-6f84-455b-b452-97e87178d8f9', '72ece276-48b7-4524-9c99-01b3792fe97c', 'dfd848db-d770-42e1-ad5a-3a9c13fa23f1'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Delete snapshot completed successfully.
Apr 09 10:48:45 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-740b8fb4-fd6d-4351-b952-18d4dbd50f1a" returned: 0 in 0.616s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ba7b1a48-5d62-4492-a4a0-075ddbba8afb tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-9d528b01-697c-439d-857d-2df928d8c57f-delete_snapshot" released by "delete_snapshot" :: held 3.570s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-740b8fb4-fd6d-4351-b952-18d4dbd50f1a" released by "delete_volume" :: held 2.223s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created reservations ['b028645b-9d14-4cea-8e8b-c3d780acbe41', '4a08dbab-8f1c-46c2-9e94-29e8cdd3608a', '487e01d6-3b38-41ac-9098-b5655801acc8', '9e9dc21c-ee0c-4f9d-91b8-02df3be85575'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:45 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:45 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:45 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.626s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:48:45 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Converted 1024.00 MB image at 419.59 MB/s
Apr 09 10:48:45 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea is being set with open permissions: ugo+rw
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:45 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea
Apr 09 10:48:45 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:45 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.441s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:45 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Deleted volume successfully.
Apr 09 10:48:45 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-f2c6c2b2-e8cd-49f2-9e85-8edd9cffc932 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-740b8fb4-fd6d-4351-b952-18d4dbd50f1a-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-6de216ec-bc20-4c16-9f19-714d3230b93a-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-6de216ec-bc20-4c16-9f19-714d3230b93a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "cinder-quobyte-6de216ec-bc20-4c16-9f19-714d3230b93a" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-6de216ec-bc20-4c16-9f19-714d3230b93a" acquired by "delete_volume" :: waited 0.018s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd580fe-a314-415e-9292-b5269294ec49]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:46 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea" returned: 0 in 0.448s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-67efa41b-85f2-4844-b260-9273077a91ea" released by "_copy_volume_from_snapshot" :: held 4.676s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-d5815800-8a1b-40cd-b1f0-f5ba46095216-67efa41b-85f2-4844-b260-9273077a91ea" released by "_create_volume_from_snapshot" :: held 4.702s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.735s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.049s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:46 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Cloning volume 5479838d-8cd1-472a-812e-319737ee8237 to volume 099dbcb4-beac-4b0e-9b43-57e6fc323371
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Creating offline snapshot b957dea0-b398-4223-8a25-f4635de38d8b of volume 5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:48:46 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a
Apr 09 10:48:46 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b472ad-dab5-4f6e-965c-6f2a0b560ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67efa41b-85f2-4844-b260-9273077a91ea', 'volume_size': 1, 'snapshot_id': 'd5815800-8a1b-40cd-b1f0-f5ba46095216'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca32732-b63c-4cc1-bd04-b890000d7b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[976341b0-5f08-4de5-8049-48cc00acec46]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:46 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Volume volume-67efa41b-85f2-4844-b260-9273077a91ea (67efa41b-85f2-4844-b260-9273077a91ea): created successfully
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca32732-b63c-4cc1-bd04-b890000d7b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Flow 'volume_create_manager' (d80159a9-3ee0-4c60-92ba-6f7eda4642b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:46 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-bd29f76d-e6eb-47f2-a399-26f3f4bd445b tempest-SnapshotDependencyTests-1909497001 None] Created volume successfully.
Apr 09 10:48:46 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:46 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-quobyte-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0000c5d5-8f5c-4c26-aaf1-58617064af33]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-d5815800-8a1b-40cd-b1f0-f5ba46095216-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-d5815800-8a1b-40cd-b1f0-f5ba46095216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-quobyte-3bbb4180-0271-43ca-a8cd-af1c936014d1" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-3bbb4180-0271-43ca-a8cd-af1c936014d1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-quobyte-d5815800-8a1b-40cd-b1f0-f5ba46095216" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-d5815800-8a1b-40cd-b1f0-f5ba46095216" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Deleting offline snapshot d5815800-8a1b-40cd-b1f0-f5ba46095216 of volume 3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] snapshot_file for this snap is: volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd8701-2b9a-4acf-b305-09c20e6c7271]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:46 devstack sudo[90676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783
Apr 09 10:48:46 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:46 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a" returned: 0 in 0.553s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:46 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216
Apr 09 10:48:46 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:46 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a
Apr 09 10:48:46 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:46 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:46 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:46 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b 1G
Apr 09 10:48:46 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783" returned: 0 in 0.538s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783
Apr 09 10:48:47 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216" returned: 0 in 0.504s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bbb4180-0271-43ca-a8cd-af1c936014d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e14a762-939e-475d-9dca-7117e001f08a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-6de216ec-bc20-4c16-9f19-714d3230b93a" returned: 0 in 0.483s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-quobyte-6de216ec-bc20-4c16-9f19-714d3230b93a" released by "delete_volume" :: held 1.064s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:47 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:47 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Created reservations ['6ee6857c-a681-4ff0-9e89-87f0554e1c78', 'c2ba8bad-3627-43bf-8ffc-0496fb096b70', 'eafac1ee-a0db-4641-b74c-55f102948ad8', 'f919ab40-211f-4237-b4db-2f43f8247d04'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:47 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b 1G" returned: 0 in 0.549s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5479838d-8cd1-472a-812e-319737ee8237 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5479838d-8cd1-472a-812e-319737ee8237 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b
Apr 09 10:48:47 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783" returned: 0 in 0.526s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783" released by "delete_volume" :: held 1.087s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created reservations ['7ebc45da-e493-41bc-8295-1f6e1e3615c1', '6c16c3d3-e872-460a-9791-684b67a6519e', '0eda5c17-e154-4d78-936f-f371a18cc795', '1f55e46d-8aed-4b3c-a4a4-f12c8b6ebd37'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:47 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216
Apr 09 10:48:47 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:47 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:47 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.495s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:47 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Deleted volume successfully.
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-56be60f3-b1f0-4ddf-b439-d7e409c66c15 tempest-CreateVolumesFromSnapshotTest-1082376239 None] Lock "cinder-6de216ec-bc20-4c16-9f19-714d3230b93a-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:47 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5479838d-8cd1-472a-812e-319737ee8237 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b" returned: 0 in 0.508s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:47 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b is being set with open permissions: ugo+rw
Apr 09 10:48:47 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:47 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b
Apr 09 10:48:47 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:48 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.438s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:48 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216" returned: 0 in 0.490s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Deleted volume successfully.
Apr 09 10:48:48 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216
Apr 09 10:48:48 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ae7d7efe-e8ad-431f-af08-5aeacd6cd4e6 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-f8a28ab5-9f6b-4d38-8f92-1d5a3fb3e783-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:48 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b" returned: 0 in 0.442s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:48 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info
Apr 09 10:48:48 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:48 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1.d5815800-8a1b-40cd-b1f0-f5ba46095216" returned: 0 in 0.433s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-d5815800-8a1b-40cd-b1f0-f5ba46095216" released by "_delete_snapshot" :: held 2.010s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-3bbb4180-0271-43ca-a8cd-af1c936014d1" released by "delete_snapshot" :: held 2.022s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-3bb48e01-71bf-4230-92d6-475dce3bd6df-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-3bb48e01-71bf-4230-92d6-475dce3bd6df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Created reservations ['25a76776-c433-4e57-9fde-13bfa8cfc6c2', '816726b3-707c-4536-bd72-c6a53f4a32be', '576a80c1-8921-4959-bea4-4d12c62ebc2c', 'd754e33c-5c8e-43a7-a80b-d1acbe397b82'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-quobyte-3bb48e01-71bf-4230-92d6-475dce3bd6df" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-3bb48e01-71bf-4230-92d6-475dce3bd6df" acquired by "delete_volume" :: waited 0.022s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73c567-9007-4d4b-9184-3eb9f2ec486b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:48 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info" returned: 0 in 0.516s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:48 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info is being set with open permissions: ugo+rw
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:48 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Delete snapshot completed successfully.
Apr 09 10:48:48 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info
Apr 09 10:48:48 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:48 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-3f11e497-f64a-4d4d-b7a2-dcb1794b18c2 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-d5815800-8a1b-40cd-b1f0-f5ba46095216-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:48 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df
Apr 09 10:48:48 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:49 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df" returned: 0 in 0.537s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:49 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.info" returned: 0 in 0.527s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-099dbcb4-beac-4b0e-9b43-57e6fc323371" by "_copy_volume_from_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:49 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df
Apr 09 10:48:49 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-099dbcb4-beac-4b0e-9b43-57e6fc323371" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] snapshot: b957dea0-b398-4223-8a25-f4635de38d8b, volume: 099dbcb4-beac-4b0e-9b43-57e6fc323371,  {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c26573b-a424-407f-9acb-35cc218ba42a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:49 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b
Apr 09 10:48:49 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-3bbb4180-0271-43ca-a8cd-af1c936014d1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-3bbb4180-0271-43ca-a8cd-af1c936014d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-quobyte-3bbb4180-0271-43ca-a8cd-af1c936014d1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:49 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-3bbb4180-0271-43ca-a8cd-af1c936014d1" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bb48e01-71bf-4230-92d6-475dce3bd6df" returned: 0 in 0.489s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73dfea1-e69b-4700-8294-4dbdfac747e3]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-3bb48e01-71bf-4230-92d6-475dce3bd6df" released by "delete_volume" :: held 1.082s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created reservations ['579870ec-3e0e-4fd0-a2e4-830ad9485751', 'ef03fef6-faa9-4e60-a86d-1fe0e84abcf4', '68fd54e4-edbc-4b02-9fbc-97a40eb9a9e0', '2e743f0b-caa1-4ca3-8334-ed61d146c2aa'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:49 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:49 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:49 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:49 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:49 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:50 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b" returned: 0 in 0.628s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5479838d-8cd1-472a-812e-319737ee8237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Creating direct copy from snapshot {{(pid=82783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b6e52-a1fc-4482-88da-402f67984db3]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:50 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:50 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Flow 'volume_create_manager' (1d2e107b-7514-46d4-9ee7-19e7836b70af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086b0a69-a1de-4e6b-a539-8e530171d1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086b0a69-a1de-4e6b-a539-8e530171d1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419a6560-e1b7-410a-a360-1ab35d1a9f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea8654fda314d189565e6fed36138b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:50Z,use_quota=True,user_id='20a79e59d06d44fa90bbfa2df205448f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3005ed96-0242-4ce8-bbc2-62d000b177ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3005ed96-0242-4ce8-bbc2-62d000b177ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756cea14-73d9-472b-9cd8-e9f44f65959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756cea14-73d9-472b-9cd8-e9f44f65959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419a6560-e1b7-410a-a360-1ab35d1a9f76', 'volume_name': 'volume-419a6560-e1b7-410a-a360-1ab35d1a9f76', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b269fdaf-3b85-4a84-9545-673e15112ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b269fdaf-3b85-4a84-9545-673e15112ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc2166-c5dd-4c9d-93fa-a94751954158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:50 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Volume 419a6560-e1b7-410a-a360-1ab35d1a9f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419a6560-e1b7-410a-a360-1ab35d1a9f76', 'volume_size': 1}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:50 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:50 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1
Apr 09 10:48:50 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:50 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.503s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:50 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Deleted volume successfully.
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-6680ad5c-8e53-4188-a40b-02c5a0077201 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-3bb48e01-71bf-4230-92d6-475dce3bd6df-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:50 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.563s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.utils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Path /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 not found in is_blk_device check {{(pid=82783) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:50 devstack sudo[90797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371
Apr 09 10:48:50 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:50 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-3bbb4180-0271-43ca-a8cd-af1c936014d1" returned: 0 in 0.439s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-3bbb4180-0271-43ca-a8cd-af1c936014d1" released by "delete_volume" :: held 1.007s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Created reservations ['b8101df5-7031-42b6-ab06-4b82aaf9b801', 'a9714084-f7fb-41e1-9e3b-035798481fac', '28f5d566-5313-4b0f-8793-8d51f4156d12', 'cb2458eb-f81b-4ba9-a8de-3d9f160d65ce'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-f23430f2-9cf3-469d-888f-8be735917dad-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:50 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:50 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-f23430f2-9cf3-469d-888f-8be735917dad-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-quobyte-f23430f2-9cf3-469d-888f-8be735917dad" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-f23430f2-9cf3-469d-888f-8be735917dad" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9528b1c-dbaf-4332-ab54-1872b5294fc5]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:50 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:51 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad
Apr 09 10:48:51 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:51 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.924s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:51 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:51 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Deleted volume successfully.
Apr 09 10:48:51 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-78c9b2ee-c3d0-49bb-aeae-e357f4406ad3 tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-3bbb4180-0271-43ca-a8cd-af1c936014d1-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:51 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad" returned: 0 in 0.980s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:51 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:52 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad
Apr 09 10:48:52 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-67efa41b-85f2-4844-b260-9273077a91ea-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-67efa41b-85f2-4844-b260-9273077a91ea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "cinder-quobyte-67efa41b-85f2-4844-b260-9273077a91ea" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-67efa41b-85f2-4844-b260-9273077a91ea" acquired by "delete_volume" :: waited 0.032s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d52bc0-f4b8-4cb8-89e4-ee768808065e]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:52 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea
Apr 09 10:48:52 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:52 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371" returned: 0 in 2.361s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d6f6d-f502-43bb-ad90-ea44da997739]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:52 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:53 devstack sudo[90826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:53 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:53 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea" returned: 0 in 0.867s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:53 devstack sudo[90832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea
Apr 09 10:48:53 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:53 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-f23430f2-9cf3-469d-888f-8be735917dad" returned: 0 in 1.234s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-f23430f2-9cf3-469d-888f-8be735917dad" released by "delete_volume" :: held 2.236s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created reservations ['f49d97f7-5ac7-44ff-a360-75167fd26273', '60a1eb4a-20f5-427a-af7a-c9f065eadca5', '8b226329-7c33-44cf-b27b-ef39d517e5df', '01891ddb-b987-4f9f-8b80-a2fb2b5af9c5'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:53 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:53 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:53 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.659s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.image.image_utils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 {{(pid=82783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 10:48:53 devstack cinder-volume[82783]: INFO cinder.image.image_utils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Converted 1024.00 MB image at 433.51 MB/s
Apr 09 10:48:53 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 is being set with open permissions: ugo+rw
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:53 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371
Apr 09 10:48:53 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:53 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-67efa41b-85f2-4844-b260-9273077a91ea" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-quobyte-67efa41b-85f2-4844-b260-9273077a91ea" released by "delete_volume" :: held 1.435s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:53 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.429s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:53 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Deleted volume successfully.
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Created reservations ['2ff1aa62-49d0-4818-9f02-fb52e1e248b2', '0627902b-2be4-4848-a440-7cdf2840a6cf', '2c88d090-82a6-44aa-84fa-34612a819392', 'b89087d3-293d-4807-8ac8-a2b4bc8dc6c0'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-c36bdc34-d8a3-4ce9-b8d6-805d5eca1a83 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-f23430f2-9cf3-469d-888f-8be735917dad-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:53 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:53 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:53 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:54 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371" returned: 0 in 0.427s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-099dbcb4-beac-4b0e-9b43-57e6fc323371" released by "_copy_volume_from_snapshot" :: held 4.696s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-b957dea0-b398-4223-8a25-f4635de38d8b" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-b957dea0-b398-4223-8a25-f4635de38d8b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Deleting offline snapshot b957dea0-b398-4223-8a25-f4635de38d8b of volume 5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] snapshot_file for this snap is: volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a93bd-5b5c-4765-93db-96874c557998]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:54 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b
Apr 09 10:48:54 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:54 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.446s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:54 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Deleted volume successfully.
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "cinder-quobyte-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5" acquired by "delete_volume" :: waited 0.010s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-202b0a9f-215f-41ac-938c-1f926ea4fc7d tempest-SnapshotDependencyTests-1909497001 None] Lock "cinder-67efa41b-85f2-4844-b260-9273077a91ea-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c6f47-3ce5-48e8-843d-c8697f4eceaf]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:54 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5
Apr 09 10:48:54 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:54 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b" returned: 0 in 0.505s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5479838d-8cd1-472a-812e-319737ee8237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c42018-1c9d-47a6-a237-fa17efa186a9]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:54 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:54 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:54 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5" returned: 0 in 0.510s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:54 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:54 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5
Apr 09 10:48:54 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:55 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.522s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:55 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b
Apr 09 10:48:55 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:55 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5" returned: 0 in 0.475s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-quobyte-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5" released by "delete_volume" :: held 1.013s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Created reservations ['07fdfe89-5768-4a68-8db8-f0f1fe4747b3', '9e30169e-ce49-4984-9e73-146996804809', '3a99aa7a-4fc6-4274-a62f-29c2e3009cf7', 'e2b559ff-5c7d-4fcb-8fc2-fd43abdd38dc'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:55 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:55 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:55 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:55 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b
Apr 09 10:48:55 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:55 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.523s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:55 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Deleted volume successfully.
Apr 09 10:48:55 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ef1498dc-4f21-4d23-9db2-86f3f595b630 tempest-CreateVolumesFromSourceVolumeTest-455364667 None] Lock "cinder-b41f5feb-7d05-4bf6-8cf4-a8a811012bc5-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:56 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237.b957dea0-b398-4223-8a25-f4635de38d8b" returned: 0 in 0.470s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-b957dea0-b398-4223-8a25-f4635de38d8b" released by "_delete_snapshot" :: held 2.030s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.948s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.834s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419a6560-e1b7-410a-a360-1ab35d1a9f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea8654fda314d189565e6fed36138b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:50Z,use_quota=True,user_id='20a79e59d06d44fa90bbfa2df205448f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Creating volume 419a6560-e1b7-410a-a360-1ab35d1a9f76 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:56 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7259f1b0-a428-493c-984f-b30e7fecdc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099dbcb4-beac-4b0e-9b43-57e6fc323371', 'volume_size': 1, 'source_volid': '5479838d-8cd1-472a-812e-319737ee8237', 'source_volstatus': 'available'}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6181a1-4f0f-4977-bee0-48e2e6844635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:56 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 1073741824
Apr 09 10:48:56 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:56 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Volume volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 (099dbcb4-beac-4b0e-9b43-57e6fc323371): created successfully
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6181a1-4f0f-4977-bee0-48e2e6844635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Flow 'volume_create_manager' (c0fd869f-98ae-4dec-acb6-4bf323001055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:56 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-2be27caa-3843-42d3-9b5a-8d9d2a3ecfdb tempest-VolumeDependencyTests-997215210 None] Created volume successfully.
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-5479838d-8cd1-472a-812e-319737ee8237-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Lock "cinder-5479838d-8cd1-472a-812e-319737ee8237-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-5479838d-8cd1-472a-812e-319737ee8237" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-5479838d-8cd1-472a-812e-319737ee8237" acquired by "delete_volume" :: waited 0.015s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb5e099-98f4-4aee-b679-2bd489520875]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:56 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 1073741824" returned: 0 in 0.626s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:56 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:56 devstack sudo[90882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:56 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:56 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76
Apr 09 10:48:56 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:57 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.672s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:57 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237
Apr 09 10:48:57 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:57 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76" returned: 0 in 0.636s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc2166-c5dd-4c9d-93fa-a94751954158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419a6560-e1b7-410a-a360-1ab35d1a9f76', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8221559e-4769-4e27-acd8-249b6e995aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:57 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Volume volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 (419a6560-e1b7-410a-a360-1ab35d1a9f76): created successfully
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8221559e-4769-4e27-acd8-249b6e995aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Flow 'volume_create_manager' (1d2e107b-7514-46d4-9ee7-19e7836b70af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:57 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-c022e9f8-7bec-4606-9fc1-13cb76ee2276 tempest-CinderUnicodeTest-1452817632 None] Created volume successfully.
Apr 09 10:48:57 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-5479838d-8cd1-472a-812e-319737ee8237" returned: 0 in 0.512s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-5479838d-8cd1-472a-812e-319737ee8237" released by "delete_volume" :: held 1.230s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Created reservations ['7a802241-e2c4-4a7a-9463-00ac7ec839bd', '293deb1e-cdb4-4226-911e-258eea256888', '83033514-3022-40d8-81a4-a5def7a7d7c6', 'aa5775e1-37e9-4db9-9e4a-6c42374e58f6'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:57 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:58 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:48:58 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Flow 'volume_create_manager' (fffb061f-4238-4dcf-80f3-24a876ff4695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08364fea-6604-4a7d-9f0c-35d3f4bf1884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08364fea-6604-4a7d-9f0c-35d3f4bf1884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-139735410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e75512-2408-42b6-ad92-02a93c295489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea8654fda314d189565e6fed36138b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:58Z,use_quota=True,user_id='20a79e59d06d44fa90bbfa2df205448f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec70998e-0a51-4e93-89ae-64a64c598d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec70998e-0a51-4e93-89ae-64a64c598d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1152d8e-7304-4d42-bbf8-0b997b8cb0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1152d8e-7304-4d42-bbf8-0b997b8cb0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e75512-2408-42b6-ad92-02a93c295489', 'volume_name': 'volume-a9e75512-2408-42b6-ad92-02a93c295489', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46eda1d-ea3e-4190-ad38-33f1ebce1337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46eda1d-ea3e-4190-ad38-33f1ebce1337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a69f35-43ae-4409-a092-3e5c66a5e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:58 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Volume a9e75512-2408-42b6-ad92-02a93c295489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e75512-2408-42b6-ad92-02a93c295489', 'volume_size': 1}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6962f3dc30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T08:48:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-139735410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e75512-2408-42b6-ad92-02a93c295489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea8654fda314d189565e6fed36138b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T08:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T08:48:58Z,use_quota=True,user_id='20a79e59d06d44fa90bbfa2df205448f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b658b0-a324-4d07-a7a7-51405896a760),volume_type_id=27b658b0-a324-4d07-a7a7-51405896a760)}" {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Creating volume a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Selected osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427 as target Quobyte volume. {{(pid=82783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 10:48:58 devstack cinder-volume[82783]: INFO cinder.volume.drivers.remotefs [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] casted to osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 1073741824 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:58 devstack sudo[90896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 1073741824
Apr 09 10:48:58 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:58 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.477s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:48:58 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Deleted volume successfully.
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-149fa059-6218-4aed-ad42-8c2fcb7022be tempest-VolumeDependencyTests-997215210 None] Lock "cinder-5479838d-8cd1-472a-812e-319737ee8237-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:48:58 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 1073741824" returned: 0 in 0.538s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:58 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489
Apr 09 10:48:58 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-099dbcb4-beac-4b0e-9b43-57e6fc323371-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-099dbcb4-beac-4b0e-9b43-57e6fc323371-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-099dbcb4-beac-4b0e-9b43-57e6fc323371" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-099dbcb4-beac-4b0e-9b43-57e6fc323371" acquired by "delete_volume" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9cd183-23b4-47c6-bc01-4513bdb31c37]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:48:58 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:59 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371
Apr 09 10:48:59 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:59 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489" returned: 0 in 0.503s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'} {{(pid=82783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a69f35-43ae-4409-a092-3e5c66a5e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e75512-2408-42b6-ad92-02a93c295489', 'volume_size': 1}' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f94be57-7e52-458f-95c9-b3f5449a469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 10:48:59 devstack cinder-volume[82783]: INFO cinder.volume.flows.manager.create_volume [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Volume volume-a9e75512-2408-42b6-ad92-02a93c295489 (a9e75512-2408-42b6-ad92-02a93c295489): created successfully
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f94be57-7e52-458f-95c9-b3f5449a469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82783) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Flow 'volume_create_manager' (fffb061f-4238-4dcf-80f3-24a876ff4695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82783) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 10:48:59 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ec1e08db-6baf-449a-84c6-edb7e9ca94ab tempest-CinderUnicodeTest-1452817632 None] Created volume successfully.
Apr 09 10:48:59 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371" returned: 0 in 0.551s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:48:59 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371
Apr 09 10:48:59 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:48:59 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Apr 09 10:48:59 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-099dbcb4-beac-4b0e-9b43-57e6fc323371" returned: 0 in 0.497s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-099dbcb4-beac-4b0e-9b43-57e6fc323371" released by "delete_volume" :: held 1.072s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Created reservations ['f56687ca-a1c7-4407-8c17-ba06956d66d6', '11fc1ec9-e908-4b9a-b8f8-e58212ea5823', '2666f6b8-f3b4-4ea0-9f7a-cbd4e3f1e888', '40ab6b2f-0370-4ebb-a9e9-749ec5f8e132'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:00 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:49:00 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Creating offline snapshot 8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 of volume a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ad11f-83af-4833-af27-78f2b38d253a]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:00 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489
Apr 09 10:49:00 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:00 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.478s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:49:00 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Deleted volume successfully.
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-a6c79a32-797d-4c17-9021-205208571828 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-099dbcb4-beac-4b0e-9b43-57e6fc323371-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:00 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489" returned: 0 in 0.517s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:00 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 1G {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:00 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 1G
Apr 09 10:49:00 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-293a4bab-305c-45c8-9152-d56de70f99e1-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-293a4bab-305c-45c8-9152-d56de70f99e1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "cinder-quobyte-293a4bab-305c-45c8-9152-d56de70f99e1" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-293a4bab-305c-45c8-9152-d56de70f99e1" acquired by "delete_volume" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6490e60b-fd0f-4ab8-a454-68ca1df34f44]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:01 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1
Apr 09 10:49:01 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:01 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 1G" returned: 0 in 0.514s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e75512-2408-42b6-ad92-02a93c295489 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:01 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e75512-2408-42b6-ad92-02a93c295489 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695
Apr 09 10:49:01 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:01 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1" returned: 0 in 0.468s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:01 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1
Apr 09 10:49:01 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:01 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e75512-2408-42b6-ad92-02a93c295489 -F qcow2 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" returned: 0 in 0.448s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:01 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 is being set with open permissions: ugo+rw
Apr 09 10:49:01 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:01 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695
Apr 09 10:49:01 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:02 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-293a4bab-305c-45c8-9152-d56de70f99e1" returned: 0 in 0.401s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-quobyte-293a4bab-305c-45c8-9152-d56de70f99e1" released by "delete_volume" :: held 0.890s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Created reservations ['a13f6ffa-5bdf-4d83-85df-b8ea2ce27bff', '2ea38cee-a5ab-4f53-8e81-dec9f36257cd', '5da28998-36c8-419b-9f21-87fe40127b70', 'ca1fe05d-604e-48c8-8019-0273f723f697'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:02 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:49:02 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:02 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" returned: 0 in 0.473s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:02 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info
Apr 09 10:49:02 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:02 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.472s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:49:02 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Deleted volume successfully.
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-5bafc0dd-7991-48e0-bcf4-1b4aa0db4382 tempest-VolumeDependencyTests-997215210 None] Lock "cinder-293a4bab-305c-45c8-9152-d56de70f99e1-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:02 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info" returned: 0 in 0.476s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:02 devstack cinder-volume[82783]: WARNING cinder.volume.drivers.remotefs [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info is being set with open permissions: ugo+rw
Apr 09 10:49:02 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:02 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info
Apr 09 10:49:02 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:03 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.info" returned: 0 in 0.432s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:49:03 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-92b8fa80-41d2-4477-ac99-747642fe1128 tempest-CinderUnicodeTest-1452817632 None] Create snapshot completed successfully
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-8f5c8e40-1df4-4d2b-ad45-2f22f1b83695-delete_snapshot" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-8f5c8e40-1df4-4d2b-ad45-2f22f1b83695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-quobyte-a9e75512-2408-42b6-ad92-02a93c295489" by "delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-a9e75512-2408-42b6-ad92-02a93c295489" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-quobyte-8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" by "_delete_snapshot" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Deleting offline snapshot 8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 of volume a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] snapshot_file for this snap is: volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 {{(pid=82783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa9544-8373-4b3c-bed9-0d1b1d87a51b]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:49:03 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:03 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695
Apr 09 10:49:03 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:04 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" returned: 0 in 0.495s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:04 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.remotefs [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e75512-2408-42b6-ad92-02a93c295489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 10:49:04 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[18101482-791c-43a9-bfe3-546f9e4883b7]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:49:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:04 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489
Apr 09 10:49:04 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:04 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:04 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695
Apr 09 10:49:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489" returned: 0 in 0.454s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:04 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:04 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:05 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" returned: 0 in 0.456s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:05 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695
Apr 09 10:49:05 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:05 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489.8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" returned: 0 in 0.400s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-8f5c8e40-1df4-4d2b-ad45-2f22f1b83695" released by "_delete_snapshot" :: held 1.858s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-a9e75512-2408-42b6-ad92-02a93c295489" released by "delete_snapshot" :: held 1.874s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Created reservations ['d0098130-430d-4ab8-bb60-6cf63f5cd60b', '40f41532-4669-40eb-b0cb-9029c04466ba', '87c1e738-cee9-4a75-9c3c-f6747b14e13a', 'ca0b3449-1e81-4c43-b1e8-78edfed02a09'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:49:05 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Delete snapshot completed successfully.
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-74266c78-036d-4b78-bfa2-1142e3be7e93 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-8f5c8e40-1df4-4d2b-ad45-2f22f1b83695-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-a9e75512-2408-42b6-ad92-02a93c295489-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-a9e75512-2408-42b6-ad92-02a93c295489-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-quobyte-a9e75512-2408-42b6-ad92-02a93c295489" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-a9e75512-2408-42b6-ad92-02a93c295489" acquired by "delete_volume" :: waited 0.011s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb21a385-b9da-43ec-a8a4-e4b3c0fcfc2c]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:49:05 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:05 devstack sudo[90974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489
Apr 09 10:49:05 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:06 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489" returned: 0 in 0.459s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:06 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489
Apr 09 10:49:06 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:06 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-a9e75512-2408-42b6-ad92-02a93c295489" returned: 0 in 0.411s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-a9e75512-2408-42b6-ad92-02a93c295489" released by "delete_volume" :: held 0.897s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Created reservations ['777b522c-839d-4575-9f92-82ae391eb697', '30f5545c-bde5-44cb-81d5-490afb809809', '486ec8a1-cde5-4971-b814-8bc274921713', 'be42e88d-3a70-448b-90bf-57cdd8502f15'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:06 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:49:06 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-419a6560-e1b7-410a-a360-1ab35d1a9f76-delete_volume" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-419a6560-e1b7-410a-a360-1ab35d1a9f76-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "cinder-quobyte-419a6560-e1b7-410a-a360-1ab35d1a9f76" by "delete_volume" {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-419a6560-e1b7-410a-a360-1ab35d1a9f76" acquired by "delete_volume" :: waited 0.009s {{(pid=82783) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdf2056-b029-4f1d-bebe-a15f755702b5]: (4, 'qcow2') {{(pid=83793) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 10:49:06 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:06 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76
Apr 09 10:49:06 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:07 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.420s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:49:07 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Deleted volume successfully.
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-ded70df1-b39f-4c70-92a0-4e9b24689661 tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-a9e75512-2408-42b6-ad92-02a93c295489-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:07 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76" returned: 0 in 0.466s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:07 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76
Apr 09 10:49:07 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:07 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4/volume-419a6560-e1b7-410a-a360-1ab35d1a9f76" returned: 0 in 0.401s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-quobyte-419a6560-e1b7-410a-a360-1ab35d1a9f76" released by "delete_volume" :: held 0.888s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG cinder.quota [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Created reservations ['894c06df-bd1d-4d11-826c-7c7bd60a1634', '64ab3559-f249-4f15-93e3-f1f60eaa067b', '7a6dcc68-b5df-4749-9e84-d1cc535fd102', '036b9e28-89ef-4a32-b2bb-13b1153405ff'] {{(pid=82783) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427': None} {{(pid=82783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG cinder.volume.drivers.quobyte [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9a75f6fd-07c2-4465-a27a-f11b89ced427'] {{(pid=82783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.lockutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82783) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 10:49:07 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4 {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 10:49:07 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4
Apr 09 10:49:07 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 10:49:08 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 09 10:49:08 devstack cinder-volume[82783]: DEBUG oslo_concurrency.processutils [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9bc1c16c84243955e5cb959325200d4" returned: 0 in 0.428s {{(pid=82783) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 10:49:08 devstack cinder-volume[82783]: DEBUG cinder.manager [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Notifying Schedulers of capabilities ... {{(pid=82783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 10:49:08 devstack cinder-volume[82783]: INFO cinder.volume.manager [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Deleted volume successfully.
Apr 09 10:49:08 devstack cinder-volume[82783]: DEBUG cinder.coordination [None req-58f32207-6d6d-436b-a919-30b0f3af773b tempest-CinderUnicodeTest-1452817632 None] Lock "cinder-419a6560-e1b7-410a-a360-1ab35d1a9f76-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82783) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 10:49:17 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:UPDATE=204,cinder:SELECT=115,cinder:DELETE=14,cinder:INSERT=49 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 10:49:18 devstack cinder-volume[82783]: DEBUG dbcounter [-] [82783] Writing DB stats cinder:SELECT=131,cinder:UPDATE=161,cinder:DELETE=15,cinder:INSERT=43 {{(pid=82783) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}